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I.  SUWARY 


Acceleration  of  the  rate  of  learning  of  a  conditioned  facial  movement  was 
accomplished  by  adding  electrical  stimulation  of  th8  hypothalamic  region  of  the 
brain  to  presentations  of  conventional  conditioned  and  unconditioned  stimuli , 
confirming  earlier  Soviet  observations  of  a  comparable  effect  of  such 
stimulation. 

The  learning  that  resulted  was  both  associative  and  discriminative.  That 
is,  learning  was  Induced  by  a  specific  stimulus  combi nation9  the  code  depending 
on  the  order  and  interval  of  presentations  of  two  different  stimuli.  The 
learned. response  was  then  elicitable  by  a  specific  input  signal. 

Our  research  indicates  that  the  pattern  of  cortical  neuronal  activity 
produced  by  hypothalamic  stimulation  predicts  loci  of  hypothalamic  stimulation 
that,  when  stimulated,  will  succeed  in  accelerating  learning. 

Part  of  the  acceleration  of  learning  the  motor  response  may  derive  from 
recruitment  of  a  new  performance  pathway  -  reflected  in  a  longer  transmission 
latency  for  movement  production.  If  so9  one  would  like  to  know  how  the  system 
picks  the  "right11  pathway  to  give  both  acceleration  and  the  "appropriate" 
learned  movement. 

Present  studies  are  directed  toward  establishment  of  whether  the 
hypothalamic  stimulation  responsible  for  acceleration  of  learning  is  punishing 
or  rewarding.  This  may9  however,  be  of  less  consequence  in  understanding  what 
is  going  on  than  would  specifying  the  coded  molecular  interactions  that  occur 
between  the  chemical (s)  released  by  hypothalamic  stimulation  and  other  chemicals 
capable  of  modifying  the  transfer  properties  of  the  nerve  cell.  It  is  these 
interactions  that  are  thought  to  be  primary  in  controlling  the  potentiation  of 
learning. 

What  is  particularly  interesting  to  us  is  the  indication  that  purposefully 
complex,  "lock  and  key"  molecular  cascades  exist  at  the  level  of  single  nerve 
cells  to  permit  "successful"  adaptations  to  occur.  "Successful"  adaptations  are 
defined  as:  (a)  producing  the  desired  alteration  of  response  to  the  appropriate 
input,  (b)  enduring  over  time,  (c)  not  interfering  with  other  adaptations 
occurring  for  other  purposes  In  the  same  cell,  and  (d)  not  interfering  with  the 
main  -  throughput  -  message  transfer  property  of  the  nerve  cell.  The  result  of 
these  adaptations  Is  to  support  the  operation  of  a  self-organizing  Information 
processing  system  with  a  high  success:  error  ratio  and  excellent  survivability 
in  the  face  of  substantial  environmental  change. 

The  nerve  network  and  elements  that  were  studied  reflect  a  much  different 
design  from  that  found  in  single  elements  of  most  artificial  information 
processing  devices.  Nonetheless,  the  design  seems  understandable  in  terms  of 
conventional  Information  processing  theory  end  in  terms  of  conventional  systems 
analysis  approaches.  (For  a  brief  summary  of  the  latter  see  the  enclosed 
Appendix  excerpted  from  a  recent  book  of  mine.) 

Sons  of  the  complexities  of  these  nerve  cell  sdeptlve  operations  are 
exemplified  by: 


(a)  A  conductance  decrease  IPSP  that  we  have  found  after  PT 
stimulation  (this  mechanism  for  altering  neural  excitability  works  in  just 
the  opposite  way  from  classical  conductance  increase  mechanisms  of  PSP 
generation) v 

(b)  The  fact  that  both  a  strong  depolarization  signal  and  the 
availability  of  a  calcium-activated  protein  kinase  or  analogously  activated 
post  synaptic  modulatory  chemicals  may  be  needed  to  change  the  membrane 
response  (to  acetylcholine  or  cyclic  GMP)  from  a  transient  change  to  a 
persistant  one. 

We  think  that  we  are  now  catching  "glimpses'*  of  some  surprisingly 
sophisticated  ways  in  which  cortical  neurons  adapt  to  support  a  whole  range  of 
newly  learned  tasks,  accomplishing  the  task  at  hand  while  maintaining  the 
potential  for  accomplishing  others. 


The  human  brain  is  the  most  powerful  adaptive  network  known  to  man.  Is  is 
responsible  for  human  intelligence  with  operations  involving  automated  image 
recognition,  speech,  decision  making  and  complex  motor  functions.  The  same 
functions  are  the  goal  of  artifice*  intelligence  operations,  robotics  and  the 
like.  Attempts  to  design  machines  to  perform  these  functions  successfully  would 
benefit  from  an  understanding  of  how  the  brain  has  succeeded  in  doing  so. 

Both  brain  and  machine  depend  on  component  operations.  There  is  reason  to 
believe  that  systems  supporting  complex  goal-seeking  adaptive  behavior  are  best 
constructed  out  of  goat-seeking  adaptive  components.  Limited  understanding  of 
how  such  components  work  has  prevented  their  incorporation  into  present 
artificial  intelligence  systems. 

In  the  brain  the  basic  component  is  the  neuron.  Recent  studies  indicate 
that  single  cortical  neurons  adapt  in  such  a  way  as  to  support  adaptive 
mammalian  behavior.  Post-synapti cal ly ,  adaptation  is  reflected  at  the  cellular 
level  by  a  change  in  neural  excitability  to  injected  current.  We  have  focussed 
our  studies  on  analysis  of  this  type  of  adaptation. 

Twelve  publications  have  resulted  from  the  research  in  this  period;  see 
1 1  at  of  publications  -  Part  IV.  The  ultimate  goal  of  the  research  is  to  provide 
a  foundation  for  the  design  of  improved  adaptive  network  architectures. 
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III.  COMPREHENSIVE  PROGRESS  REPORT  -  STATUS  OF  RESEARCH 
A.  April  19S1  to  present 

1 .  The  ejTects_of  US_jjreaantations  on  rates  of  discharge  ^nd  excitability 
to  weak  extracellular  current  were  determined  in  sinole^nits  of  the  motor 
cortex  {0ronsf  Woody  and  Allon,  Neuroohvsiol . ■  1982).  The  excitability  to 
weak  (nA)  extracellular  electrical  stimulation  was  measured  among  single  neurons 
of  the  pericruciate  cortex  of  awake  csts  as  a  function  of  behavioral  state. 
Levels  of  neuronal  excitability  were  compared  1]  after  classical  conditioning  of 
a  faci&l  movement,  2)  during  extinction  of  the  conditioned  response,  and  3) 
during  unpaired  presentations  of  conditioned  and  unconditioned  stimuli  (CS  and 
US) . 


Neurons  projective  to  facial  muscles  via  polysynaptic  corticofugal  pathways 
showed  decreased  levels  of  excitability  to  weak  extracellular  stimulation 
following  conditioning  with  forward  pairing  of  the  CS  and  US,  extinction  with 
backward  pairing  of  the  stimuli,  and  presentations  of  the  US  alone.  These 
changes  in  excitability  were  attributable  solely  to  the  effects  of  US 
presentation  and  were  not  distinguishably  different  during  either  conditioning 
or  extinction  of  the  behavioral  response.  Smalt  decreases  in  rates  of 
spontaneous  firing  were  found  to  accompany,  the  decreases  in  neural  excitability. 

The  data  support  the  conclusions  that  significant  nonassociati ve  changes  in 
neural  excitabli lity  occur  during  conditioning  and  extinction  due  to 
presentations  of  the  unconditioned  stimulus.  These  changes  support  latent 
inhibition,  behavioral ly,  and  the  mechanism  of  these  changes  is  different  from 
that  of  changes  in  postsynaptic  excitability  found,  after  conditioning,  by 
intracellular  stimulation  of  similiar  cortical  neurons  (Woody,  Fed.  Proc. .  > 
1962).  The  increased  excitability  to  intracellular  currents  facilitates 
performance  of  the  specific  type  of  motor  response  that  is  acquired  and  is  also 
latent,  awaiting  a  command  signal  that  will  cause  the  response  to  be  initiated. 

2.  Tha_raoldi tv_  of  acquisition  of  conditioned  motor  responses  was 
determined  after  adding  hypothalamic  stimulation  to__cl icii  CS  and  q label  la_tao 
US#  Our  analyses  show  a  two  order-of-magni tude  acceleration  of  the  rate  of 
acquisition  of  a  blink  response  over  that  achieved  by  pairing  the  same  CS  and  US 
without  hypothalamic  stimulation  (Kim,  Woody  and  Berthier,  Neuroohvsiol . . 
1983).  Changes  in  the  patterns  of  activity  of  single  units  of  the  motor  cortex 
are  isomorphic  with  the  development  of  the  conditioned  response  (Woody,  Kim  and 
Berthier,  ^  Neuroohvsiol..  1983). 

Additional  findings  were  obtained  following  completion  of  the  following 
computer  programs. 


Computer,  Program 

The  program  consists  of  three  functional  units:  stimulus  presentation  and 
data  collection,  histogram  generation  and  display,  and  behavioral  analysis  and 
data  storage.  Conditioned  (CS) ,  unconditioned  (US),  hypothalamic  (HS),  and 
discriminative  (DS)  stimuli  are  presented  in  a  timed  sequence  for  ten  second 
trials  of  adaptation,  conditioning,  extinction,  or  delayed  HS  paradigms.  Timing 
of  stimuli  can  be  generated  spontaneously  for  on  line  experiments  or 
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synchronized  to  an  analog  tape  pulse  for  analysis  of  prerecorded  data.  During 
each  trial,  five  seconds  of  BIG  data  encompassing  all  stimuli  are  sampled  at  2 
ms  Intervals  from  the  left  and  right  orbicularis  ocull  and  levator  oris.  Eight 
histograms  are  generated  from  the  data  and  displayed  four  each  on  Mime  100  and 
VT105  video  terminals.  The  histograms  are  averages  of  three  trials  and  are 
normalized  to  the  tallest  bln.  The  Mime  100  histograms  are  400  ms  displays 
encompassing  the  CS-US  period  for  each  EMG.  The  VT105  histograms  can  be 
dynamically  modified  by  keyboard  codes  which  can  center  histograms  around  any 
stimuli  for  any  BIG  and  display  from  100  to  1600  ms  of  data. 

The  computer  detects  conditioned  EMG  responses  using  the  criteria  that  3 
consecutive  samples  In  the  current  trial  plus  1  of  the  2  previous  trials  plus 
the  average  of  those  3  trials  must  exceed  5  standard  deviations  above  the  mean 
of  spontaneous  activity  sampled  for  400  us  before  the  CS.  The  response  must  be 
detected  between  100  ms  after  the  CS  end  20  us  before  the  US.  If  a  response 
based  on  these  criteria  Is  found,  the  three  trials  are  Individually  stored  on 
disc  while  no  response  results  In  three  trials  being  averaged  before  disc 
storage. 


Results 

The  results  of  training  cats  with  click  CS,  tap  US,  hypothalamic 
stimulation  (HS),  and  an  added  hiss  OS  are  shown  In  Figure  1.  They  Indicate 
that,  with  this  paradigm,  discriminative  responses  to  the  CS  are  acquired  within 
9  trials.  The  rate  of  acquisition  Is  two  orders  of  magnitude  faster  then  when 
HS  Is  omitted  and  permits  Intracellular  recording  from  cortical  neurons  while 
learning  takes  place.  The  latencies  of  the  CRs  range  between  100  and  300  ms. 

Additional  effects  on  conditioning  of  adding  hypothalamic  stimulation  (HS) 
to  classical  application  of  CS  (click)  and  US  (glabella  tap)  have  also  been 
examined: 

a.  Videotapes  were  made  comparing  learning  In  animals  given  stimulation  at 
effective  hypothalamic  loci  with  failure  to  learn  In  animals  given 
stimulation  at  Ineffective  hypothalamic  loci.  Figure  2  shows  some 
effective  and  Ineffective  loci  (Kim,  Woody  and  Berthler,  Jj.  Neurophyslol . . 
1983). 

b.  Patterns  of  cortical  unit  response  to  hypothalamic  stimulation  may  be 
predictive  of  an  effective  locus  of  hypothalamic  stimulation  for  producing 
enhanced  rate  of  learning.  Patterns  of  activity  such  as  that  shown  In 
Figure  3  have  been  seen  with  effective  hypothalamic  stimulation  (Woody, 

Kim,  and  Berthler,  jJjl  Neuroohvslol . .  1983). 

3.  Pilot  studies  are  underway,  to  determine  If  the  hypothalamic  stimulation 
that  leads  to  accelerated  learning  of  a  conditioned  movement  Is  rewarding 
averal va  (Berthler  et  al,  Soc.  Nauroscl .  Abatr. .  1982).  Preliminary  findings 
suggest  that  either  a  mildly  aversive  or  a  rewarding  stimulus  may  produce 
accelerated  learning.  Further  studies  are  underway  to  obtain  further 
(  Information  on  this  question. 


201-260  LATENCY  RESPONSES  261-300  LATENCY  RESPONSES 


Figure  1.  Reel dl tv  of  Conditioning  and  Latency  of  CR*a 


Development  of  EM6  responses  of  different  letencles  to  CS  (Solid  line)  or  OS 
(Dsehed  line)  In  8  cote  during  conditioning.  Responses  were  defined  es  EMG 
responses  of  grsstsr  then  5  sd  above  the  pre-CS  (spontaneous)  aean.  Ourlng 
training,  Cfls  Increased  el th  trials  reselling  asymptote  (74S  CRs)  elthln  9 
trials.  Responses  ears  classified  Into  four  elndoes  (0-90  ms,  101-800  me, 
801-880  as,  881-300  as;  top  to  bottom,  respectively).  Cats  made  more  responses 
to  the  CS  than  OS  ehen  responses  of  grestar  than  101  ms  ears  analyzed.  Ourlng 
extinction  cats  made  more  responses  to  the  CS  than  to  the  OS,  but  by  the  ninth 
trial  of  extinction  there  eas  little  responding  to  either  the  CS  or  OS. 
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*  Most  effective 

•  Effective 


a  Ineffective 


Figure  2.  Loci  of  Brain  Stimulation 

Filled  stare  represent  hypo the I amic  sites,  stimulation  of  which  produced  rapid 
acquisition  of  discriminative  eye-blink  CRs  at  over  90%  performance  level.  The 
sites  of  stimulation  that  resulted  in  discriminative  CRs  being  performed  lass 
consistently  are  represented  by  filled  circles.  8ehavioral(y  Ineffective  sites 
of  stimulation  are  Indicated  by  filled  triangles. 

Abbreviations:  Cd,  caudate  nucleus;  Ch,  optic  chiasm;  Cl,  internal  capsule; 
FX,  fornix;  6P,  globus  pal  Ildus;  LH,  lateral  hypothalamus;  Th,  thalamus;  TO, 
optic  tract;  VMM,  ventromedial  hypothalamic  nucleus. 
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Figure  3: 

Effects  of  hypothalamic  stimulation  on  single  unit  activity  recorded  from 
different  cells  in  the  corona  I -peri  cruel ate  cortex.  Examples  of  different 
cortical  unit  responses  to  the  first  train  of  stimulation  are  shown.  The 
triangles  appearing  baton  each  tracing  indicate  the  train  of  four  brief  (0.1 
msec  duration)  stimulation  pulses.  Small  downward  arrows  point  to  the  spikes. 

Hypothalamic  stimulation  resulted  in: 

A*  Early  excitation  followed  by  inhibition. 

8.  Early  and  late  excitation 

C.  Late  excitation 

0.  Inhibition 

Calibrations  are  as  indicated. 
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4.  Effects  on  cortical  neurons  of  intracellular  application  of  cyclic  AMP 
(cAMP)  have  been  investigated.  cAMP  was  applied  by  pressure  mi croinj action  (0.1 
mM  solution  in  4%  HRP  injected  at  60-80  psi  for  1-5  seconds).  The  following 
effects  were  seen  in  HRP  injected  cells:  a]  increases  followed  by  decreases  in 
firing  rate,  b)  hyperpolarization,  c)  small  decreases  in  membrane  resistance,  d) 
small  decreases  in  excitability  to  intracel lularl y  injected  current.  Pyramidal 
cells  of  layer  V  were  among  those  showing  these  responses.  The  results  indicate 
that  excitability  and  membrane  resistance  are  decreased  by  intracellular  cyclic 
AMP.  Control  studies  with  intracellular  applications  of  5'  AMP  (an  inactive, 
metabolized  form  of  cyclic  AMP)  did  not  show  these  effects.  The  differences 
between  experimental  and  control  groups  were  statistically  significant. 

5.  Effects  of  PT  stimulation  on  PSP  production  were  studied  in 

intracellular  recording?  fxaa  55  cq! af  .agate  cats 

(Bindman,  Woody,  et  al,  Soc.  Neurosci ..  Abstr. .  1982).  Of  these  cells,  10 
showed  an  IPSP  that  decreased  with  hyperpolarization  and,  in  5  of  the  10  cells, 
the  IPSP  was  reversed  with  additional  hyperpolarizati ng  current.  In  9  of  the 
cells,  it  was  possible  to  measure  a  decrease  in  resistance  at  the  time  of  the 
IPSP.  This  IPSP  has  been  recognized  previously  by  other  investigators  and  is 
thought  to  reflect  an  increase  in  chloride  conductance.  In  30  of  the  remaining 
cells,  a  quite  different  IPSP  was  found  during  the  same  35-120  msec  period 
following  PT  stimulation.  In  each  of  these  cells,  the  IPSP  increased  in  size 
with  the  application  of  hyperpo I  arizing^  currant  and  could  not  be  reversed  with 
hyperpelarizatiort  tsee  Fig.  4).  With  depolarizing  current  the  IPSP  decreased 
in  size.  The  resistance  was  measured  at  the  time  of  the  IPSP  by  comparing  the 
magnitude  of  a  continuously  repeated  (20  ms  on,  20  msec  off)  bridge  pulse  during 
the  IPSP  with  that  prior  to  the  PT  shock  that  elicited  the  IPSP.  An  increased 
resistance  was  found  to  accompany  the  IPSP.  Conductance  decrease  IPSPs.were 
seen  in  these  cells  irrespective  of  whether  antidromic  spikes  were  produced  by 
PT  stimulation.  Conductance  decrease  IPSPs  have  been  reported  previously 
(Siggins  et  al,  1971;  Engberg  and  Marshall,  1971;  Smith  and  Weight,  1977),  but 
not  in  neurons  of  the  motor  cortax.  (PT  stimulation  is  an  effective  US  in 
producing  conditioned  behavior  [Obrien  et  at.,  1977].) 

6.  Injections  of  calcium  ions  and  HRP  were  made  intracel lularl v  in  neurons 
of  the  motor  cortax  0/  awake. _unparal vzad  cats.  Pressure  injection  res  used  to 
avoid  voltage  dependent  calcium  flux  that  could  arise  from  iontophoreti c 
application.  Twejve  cells  with  resting  potentials  averaging  49mV  were  injected 
with  4%  HRP  in  10  n  CaClp.  Twenty-nine  celts  injected  with  HRP  without 
additional  calcium  had  resting  potentials  averaging  47mV.  Injections  with 
calcium  produced  an  increase  in  conductance  measured  by  the  differential  spike 
height  method  that  was  usually  sustained  over  the  course  of  3  minutes. 

Injections  of  HRP  alone  produced  no  change  or  significantly  smaller  conductance 
increases.  HRP  solutions  were  found  to  contain  as  much  as  10-4M  free  calcium 
ions.  Cells  responding  to  calcium  with  a  conductance  increase  were  identified 
as  pyramidal  cells  of  layers  II,  III  and  V  (Wallis  et  al.,  Soc.  Neurosci . 

Afaatr, .  1982). 
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Figure  4.  An  anti droraically  activated  neuron  of  the  motor  cortex  with  an 
IPSP  (arrow)  that  increased  with  hyperpolarizing  currant.  A:  Effects  on  the 
IPSP  of  applying  both  negative  and  positive  steady  current  (values  In  nA  as 
shown) .  An  increase  in  the  rata  of  spike  discharge  and  a  reduction  in  spike 
amplitude  accompanied  the  application  of  steady  depolarizing  current.  The 
times  of  delivery  of  the  single  PT  shocks  are  as  indicated.  8:  Applications 
of  the  recurrent  InA  depolarizing  pulse  used  to  measure  resistance  in  this 
cell.  The  resistance  is  increased  at  the  time  of  appearance  of  the  IPSP 
(arrows).  OF:  Antidromic  spikes  (a)  elicited  by  PT  stimulation.  Note 
invariant  latency  of  occurrence  and  collision  with  spontaneously  occurring 
spikes.  Spontaneously  generated  spikes  (S')  that  occur  during  conduction  of 
the  antidromic  spike  block  the  appearance  of  the  antidromic  spikes  as  shown 
in  0  and  E;  other  spontaneoua  spikes  (S)  do  not.  Application  of  steady 
hyperpolarizing  current  (-6  nA)  in  F  results  in  an  Increase  in  the  size  of 
the  antidromic  spike.  (The  tops  of  the  spikes  are  cut  off  in  comparable 
portions  of  A.)  The  voltage  calibration  in  F  applies  to  a  I  I  records  except  9, 
for  which  a  separata  calibration  is  given.  The  time  calibrations  are  for  A 
and  C-F  respectively;  the  depolarizing  pulses  in  8  are  of  15  ms  duration. 


•  ♦>. 


conducted  col laborati valv  with  Dr.  D.  Alkon  at  the  Woods  Hole  Haring  Biological 
Laboratory .  Attempts  were  made  to  detect  changes  in  membrane  properties 
controlling  the  development  of  excitability  Increases  found  after  conditioning. 
Cat  preparations  were  supplied  by  Or.  Woody.  Modifications  of  our  electrodes 
introduced  by  Or.  Alkon  facilitated  measurement  of  these  changes. 

The  effects  on  membrsne  resistance  of  injecting  calcium-calmodulin 
dependent  protein  kinase  intracsl lularly  in  units  of  the  motor  cortex  were 
studied  in  awake  cats.  Some  preliminary  results  are  shown  below  in  Figure  5. 


10/50#ms  5ms 


Figure  5.  Results  of  Intracellular  Injection  of  calcium-calmodulin  dependent 
protein  kinase  and  application  of  depolarizing  current.  Resistance  (1)  - 
before  protein  kinase  injection,  (11)  -  after  protein  kinase  Injection; 

(111)  -  spike  recorded  during  hyperpol arizing  iontophoresis  of  protein 
kinase;  resistance  (1v)  -  Immediately  after  depolarization  subsequent  to 
protsln  kinase  Injection,  (v)  -  tan  seconds  after  cassation  of 
depolarization;  (vl  -  xj  -  faater,  amplified  sweeps  showing  bridge  balance 
at  periods  corresponding  to  those  in  the  traces  to  the  left,  except  for 
( vl 1 1 )  which  shows  the  bridge  rebalanced  prior  to  the  30  sec  period  of 
depolarization.  Control  studies  performed  with  electrodes  filled  with  KCI 
without  protein  kinase  failed  to  show  resistance  increases.  Calibrations  are 
as  Indicated  below  and  to  the  right  of  each  portion  of  the  figure.  The 
voltage  calibration  applies  to  1,  11,  iv,  v  and  vi-x,  respectively. 


It  appears  that  some  of  the  same  control  mechanisms  responsible  for 
elaboration  of  assoclatlvaly  induced  behavioral  changas  in  Hermisaanda  are 
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operative  in  neurons  of  the  cat  motor  cortax  that  support  the  performance  of 
learned  motor  tasks. 

What  is  interesting  about  these  mechanisms  is  that  they  permit  the  transfer 
property  of  the  neural  element  to  operate  in  a  multimodal  manner*  one  state 
supporting  the  usual  transfer  operations*  the  other  supporting  unusual  transfer 
operations  that  require  adaptation. 

8.  Cybernetic  considerations  relevant  to  a  theoretical  approach  to 
analysis  of  neuronal  adaptation  in  a  nerve  network*  excerpted  from  a  book  on 
Memory.  Learning,  and  Higher  Function  by  Dr.  Woody*  are  enclosed  as  an  Appendix. 
Some  aspects  of  that  material  may  be  summarized  as  fol  lows: 

An  adaptive  system  can  be  described*  cybernetical ly *  as  a  system  that 
modifies  its  internal  structure  as  a  function  of  experience*  thereby  altering 
the  system  operation.  Ordinarily,  the  system  operation  will  become  increasingly 
optimized*  by  means  of  feedback*  in  the  approach  to  some  operational  goal.  In 
this  context  goal-seeking  will  be  the  process  by  which  the  component  or  adaptive 
element  moves  toward  or  maintains  a  particular  system  state.  A  key  feature  of 
any  adaptive  system  will  be  the  features  controlling  the  adaptation.  The 
control  sub-system  may  or  may  not  require  associated  memory.  If  so*  the  memory 
may  evolve  in  a  trivial  or  non-trivial  fashion*  with  or  without  variation  in  the 
original  set  point.  Control  of  goal-seeking  may  be  expected  to  be  accomplished 
by  means  of  feedback.  The  tatter  will  ordinarily  involve  some  closed-loop 
operations.  Interestingly,  a  great  many  psychophysiological  formulations  of 
adaprive  neural  sysmtems  have  neglected  to  specify  closed— loop  operations  by 
which  such  feedback  could  be  accomplished  as  opposed  to  open- loop  operations 
which  do  not  lend  themselves  to  modification  of  the  involed  element  as  a 
consequence  of  the  element's  past  adaptation  (cf.  Kandel  and  Spencer*  1968). 

Physiologically,  many  adaptive  cellular  systems  lend  themselves  to 
closed-loop  goal-seeking  processes.  These  range  from  biochemical  feedback  loops 
(within  the  metabolic  context  of  the  cell  itself)  to  recurrent  collateral 
systems  with  relatively  direct  feedback  as  well  as  indirect  feedback  through 
more  extensive  polysynaptic  networks  (cf.  Rasmussen  and  Goodman,  1977; 

Phillips*  1974).  At  the  level  of  cellular  components  in  the  brain*  there  exist 
several  candidate  mechanisms  for  the  control  of  neural  adaptation: 

I)  The  "Yin-Yang"  hypothesis  has  been  advanced  in  which  so-called 
excitatory  and  inhibitory  neurotransmitters  could  control  closed-loop 
goal-seeking  adaptations  depending  upon  neuronal  conductance  changes  by  means 
of  intracellular  second  messengers  such  as  cyclic  AMP  and  cyclic  GMP.  The 
cyclic  nucleotides  are  thought  to  interact  reciprocal ty  to  facilitate  either 
excitatory  or  inhibitory  effects  (Bloom.  1975*  1976;  Goldberg  et  al.*  1973). 

II)  The  principle  of  voltage-dependent  control  of  neuronal  spike 
activity  is  well  established.  The  possibility  areises  of  voltage  dependent 
Induction  or  potentiation  of  cyclic  nucleotide  release  as  well  as  the 
likelihood  of  coupled  sodium  or  potassium-calcium  channels  with 
voltage-dependent  features  (Loewenstein*  1975;  Lux  and  Eckert*  1974;  Heyer 
end  Lux,  1976a, b). 

ill)  Entrainment*  i.e.*  the  production  of  multiple  spike  discharges 


encroaching  upon  relative  refractory  periods,  might  furnish  a  chemical  signal 
for  cellular  mechanisms  controlling  neural  adaptation,  particularly  after 
associative  stimulus  pairings  as  in  conditioning.  In  cortical  neurons, 
antrainment  is  probabilistically  an  uncommon  event  in  contrast  with  PSP  or 
spike  production,  oar  sa.  resulting  from  natural  auditory  stimuli  which  serve 
as  CS's  in  Pavlovian  blink  conditioning  (Woody  et  al.,  1970;  Engel  and 
V/oody,  1972).  Other  evidence  (Woody  at  al.,  1976)  indicates  that  entrainment 
might  interact  with  acetylcholine  or  cyclic  GMP  to  control  aspects  of 
persistent  adaptation  in  mammalian  cortical  neurons. 

The  practical  significance  of  using  a  closed-loop  cybernetic  approach  to 
understand  cellular  adaptation,  even  at  the  biochemical  level,  is  just  beginning 
to  be  re-evaluatad  and  appreciated.  For  example,  the  following  is  excerpted 
from  a  recent  review  by  Pasmussen  and  Goodman  (1977). 


K.  MAMWmS#  AMO  D  &  P  GOODUA* 
i$rr  CALCIUM  AMU  CYCLIC  XUCLCOTIDES 

B.  Open-Loop  ut.  CUmtd-Loop  Control  Sytttm* 

L  General  feature* 

Nearly  mil  models  of  peptide  rod  amino  hormone  action,  including  the 
ncond  rosoaepgar  model.  have  bmmo  ones  in  which  m  stimulus  (the  hormone/ 
acts  on  «  particular  coil  or  subcoiluUr  system  to  product  a  physiological 
raeponee.  la  cybernetic  tanns,  this  is  defined  as  an  open-loop  system  (Fig.  2). 
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However,  in  biological  systems  st  all  levels  of  organization,  responses  are 
dependent  not  only  on  praaent  and  pest  stimuli  but  on  the  response  itself, 
according  to  the  present  organization  of  the  unit  and  its  particular  environ¬ 
ment.  This  means  that  cellular  responses  to  hormonal  stimuli  operate  not  as 
open-  but  as  doeed-loop  systems.  The  distinction  is  critically  important:  in  in 
open-loop  system  the  response  depends  on  the  stimulus,  but  the  convene  is 
not  true.  In  contrast,  in  a  closed-loop  system  the  response  mfln— the 
stimulus— i.#..  then  is  a  feedback  relationship  between  stimulus  and  ra* 
spouse  such  that  the  response  itaeif  modifies  the  effect  and  magnitude  of  the 
original  stimulus.  Endomne  physiologists  have  realized  for  yean  that  at  the 
supneeUular  level  endnotes  systems  operate  m  complex.  doosd4oop  systmna 
(337).  yet  most  endocrine  biochemists  continue  to  analyte  hormone  action  at 
the  cellular  level  in  the  contest  of  open-loop  models  (128.  190.  415). 

Considering  these  cellular  central  systems  as  doaeo-toop  systems  as 
schematised  in  Figure  2.  rather  than  »  open-loop  yin-yang  system  aa  pro¬ 
posed  by  Goldberg  et  el  (183).  adds  an  important  dimension  to  both  one's 
understanding  of  the  system  and  to  the  types  of  critical  experiments  one  can 
design  to  evaluate  the  hypothesis. 

The  importance  of  malting  this  distinction  in  analyzing  hormone  action 
Uea  in  the  kinds  of  models  of  hoemuoo  action  one  builds  Grom  experimental 
date  and  from  these  the  type  of  Anther  experiments  one  designs  to  test  these 
models.  Of  even  greater  import,  if  dosed- loop  systems  are  the  biological  rule, 
then  an  understanding  of  feedback  theory  provides  e  means  of  obtaining  a 
oorrect  intuitive  grasp  of  the  nature  of  the  control  system  in  many  situations 
in  which  an  open-loop  analysis  of  the  same  experimental  data  would  lead  to  a 
confusing  and  contradictory  conclusion. 
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Systems  of  this  type  are  of  course  restricted  in  the  type  of  operations 
they  can  perform  and  the  geometric  patterns  that  can  be  recognized.  For 
example,  such  systems  cannot  compute  connectedness  of  geometric  figures,  whereas 
they  can  compute  convexity  and  related  processing  operations  of  the  type  called 
local  or  conjunctively  local  by  Minsky  and  Papert.  Humans  may  not  be  able  to 
compute  some  forms  of  connectedness  either: 


e. g. : 


The  possibility  exists  that  a  slight  modification  of  LLttley's  algorithm  can 
result  in  the  introduction  of  a  ael f-cl assi fvi no  input.  By  self-classifying 
input  is  meant  an  input  of  particular  functional  significance  which  is 
identifiable,  within  the  adaptive  element,  by  means  of  its  stochastic  pattern  of, 
appearance  alone.  Moreover,  thi s  .stochasti c  pattern  need  not  unduly  disrupt  the 
overall  function* of  the  adaptive  element's  operation. 

The  informon  model  of  an  adaptive  neural  element  (Uttley,  1976} 
incorporates  classifying  inputs,  closed-loop  feedback  concerning  the  operational 
state  of  the  element,  and  an  appreciation  of  goal-seeking  in  the  algorithm 
regulating  useful  adaptation.  Several  constraints  are  particularized  that  are 
critical  if  the  informon  is  to  successfully  discriminate  one  input  from  another. 
These  are  a]  the  algorithm  by  which  the  weightings  of  synaptic  inputs  are 
altered,  b)  the  need  to  achieve  system  normalization  throught  negative  (not 
positive)  feedback  of  information  regarding  the  current  system  state,  and  c)  the 
need  for  a  classifying  Input  to  distinguish  or  identify  which  input  signal  is 
the  particular  signal  to  be  discriminated.  Tests  of  this  model  have  found  that 
each  of  these  constraints  is  required  for  the  element  to  adapt  usefully. 

Synaptic  weighting  is  altered  according  to  the  Shannon  mutual  information 
function  between  certain  synaptic  inputs  In  combination  with  closed-loop 
negative  feedback  reflecting  the  element's  Internal  state.  In  summary,  it  would 
appear  that  there  are  empirical  as  wall  as  theoretical  reasons  why  "smart” 
adaptive  elements  need  to  incorporate  goal-seeking  as  well  as  closed-loop 
feedback  Into  their  design. 

In  some  adaptive  networks,  input  analysis,  i.e.,  the  processing  of 
sensory- labelled  information  (cf.  Mountcastts,  1974],  is  explicable  in  terms  of 
the  group  Invariance  theorem  of  Minsky  and  Papert.  This  theorem  permits 
analysis  of  operations,  such  as  the  geopmetry  of  certain  sensory  image 
processing,  by  algebraic  means  instead  of  statistics  and  thereby  reverses  a 
trend  in  this  field.  The  group  invariance  theorem  examines  the  relationship 
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between  alt  possible  receptor  activations  (all  sets  of  sensory  labels)  and  their 
representation  across  the  theoreticat  space  of  an  adaptive  network,  given 
certain  architectural  constraints.  This  result  is  a  description  of  an  orderly 
relationship  in  which  no  matter  how  complexly  the  network  is  organized,  the 
space  requi red  for  a  particular  sensory  labelling  can  be  specified.  In  summary 
form,  the  group  invariance  theorem  states  that  if; 
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3.  Details  of  Research  supported  by  AFGSR  [1978-present)  not  covered  in  Part 
III,  A. 


1 .  The  sampling  distribution  of.  neurons  ofrtainecLbv __our_in^racel  lu tar* 
cortical  recording  procedure  was  investigated.  The  sample  of  HRP-i denti  f led 
neurone  was  found  to  be  essentially  equivalent  to  that  seen  in-si tu  [determined 
from  Golgi-stained  sections  of  these  cortical  regions).  Seventy  percent  (70%) 
of  penetrations  were  of  calls  in  layers  III  and  V,  and  70%  of  the  penetrations 
were  of  pyramidal  shaped  cells.  There  wee  a  slight  tendency  to  over-sample 
neurone  with  extensive  dendritic  arborizations.  Samplings  of  every  major 
morphologically  Identified  in-aitu  call  type  were  obtained  by  our 

al actrophyaiological  procedures  (Sakai  at  a!.,  Brain  _Ras. .  1978). 

2.  Tha  reaoonaa  properties  of  penetrated  neurons  to _1ni acted  polarizing 
currants  wars  Investigated  and  found  to  be  normal.  The  accommodative  response 
to  ramp  depolarizing  currents  was  assessed;  most  responses  were  of  the  simple 
type  rsthar  than  calling  or  minimal  gradient,  (cf.  Koike  et  al.,  Exp.  Br.  Res.. 
1968a, b).  Normal  I-V  plats  and  input  resistance  were  also  obtained.  Several 
lines  of  svi denes  suggested  that  many  cortical  nsurons  have  dendrites  that  do 
not  support  active  propagation  of  action  potentials  and,  Instead,  serve  the 
integrative  process  of  neuronal  information  handling  (Woody  and  Gruen, 

3rain  Res. .  1978). 


3.  In-vitro  calibration,  of  pressure  mlcroini.ction  techniques  wars 
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obtained.  Controlled  release  of  100  femtoliter  volumes  was  demonstrated.  A 
number  of  other  laboratories  are  adopting  this  technique  for  testing  local 
biologic  effects  of  pharmacologic  agents  (cf.  Sakai  et  at.,  Neurooharmacol . . 
1979). 


4.  Preliminary  evaluations  of  affects  of  acetylcholine  (ACh)  and  cyclic 
GMP  (cGMP)  on  cortical  neurons  ware  completed.  These  agents  appear  to  have 
similar  effects  on  input  resistance,  ACh  acting  extracel lul arl y  on  cell  surface 
receptors  (of  muscarinic  type),  cGMP  acting  intracel lularly.  The  input 
resistance  is  increased  transiently  by  the  effect  of  these  agents  alone  and 
persistently  by  application  with  cell  depolarization  sufficient  to  produce 
repeated  discharge  [Woody  et  al.,  Brain  Res. ■  1978). 

It  appears  that  neurotransmitters  act  in  a  dual  manner  in  these  cells,  as 
in  others,  to  convey  information.  One  action,  the  direct  "neurotransmitter 
effect",  serves  primarily  to  transmit  information  through  the  cell.  The  other 
action,  the  "modulatory  effect",  serves  to  control  adaptation  as  a  function  of 
the  information  transmitted.  The  two  actions  are  kept  separated  in  the 
time-frequency  domain  by  different  time  courses  of  involved  biochemical 
pathways;  (see  Klopf,  A.H.,  Brain  Function  and  Adaptive  Systems  —  A 
Heterostatic  Theory.  AFCRL  Dept.,  HI33,  1972J. 

A  third  variable,  depolarization  included  discharge,  serves  to  make  the 
adaptation  persistent  rather  than  transient. 

5.  In  ^.simulated  neuron,  consequences  of  propagative  vs.  non-prooaaati ve 
dendritic  membranes  on  information  transfer  were  studied.  With  low  rates  of 
current  spread,  graded  changes  in  threshold  produced  graded  changes  in  output 
discharge.  With  high  rates  of  current  spread,  the  neuron  became  a  bistable 
(decisional)  operator  where  spiking  was  enhanced  if  the  threshold  was  below  a 
certain  level  and  suppressed  if  above  that  level.  The  enhancement  was 
considerably  more  pronounced  in  neurons  with  non-propagati ve  than  with 
propagative  dendrites.  With  propagative  dendrites  a  less  intense  input  was 
needed  to  initiate  somatic  spiking  (Levine  and  Woody,  Biol .  Cybernetics.  1978). 

6.  Studies  of  the  ability  to  morphological  I v  identify  types  of  neurons 
responding  to  cholinergic  scents  were  conducted  using  aceclidine.  a 
cholinomimetic  druo.  Similar  effects  on  membrane  resistance  were  obtained  with 
this  drug  as  with  ACh  and  the  affects  could  be  blocked  by  atropine  (a  muscarinic 
receptor  blocker).  A  cell  responding  to  aceclidine  with  an  increased  resistance 
was  identified  by  injection  of  HRP  as  a  pyramidal  cell  of  layer  VI  (Swartz  et 
al.,  Proc.  West.  Pharm.  Soc..  1978). 

7.  Effects  of  acetylcholine  lACh)  and  cyclic  GMP  fcGMP)  on  inout 
resistance  ware  studied  in  groups  of  morphologically  identified  neurons.  HRP 
was  pressure  injected  into  the  celts  after  atudylng  the  effects  of  ACh.  cGMP 
was  also  applied  Intracel lularl y  by  pressure  injection.  Pyramidal  cel  la  of 
layers  V  and  VI  responded  to  these  agents  with  Increases  in  resistance.  The 
responsive  neurons  Included  those  of  layer  V  activated  antidromical ly  by  PT 
stimulation. 

A  comparison  of  the  results  of  pressure  injected  cGMP  with  those  of 
Intracel lul arl y  iontophoresed  cGMP  shows  similar  changes  in  resistance,  but  the 


increase  in  firing  rate  after  the  hyperpotarizing  iontophoresis  does  not  occur 
after  pressure  injection.  The  results  suggest  that  cGMP  and  acetylcholine 
produce  simitar  effects  in  similar  neurons  of  the  motor  cortexr  the  primary 
effect  being  a  conductance  decrease.  The  increase  in  firing  rate  following 
application  of  acetylcholine  appears  to  be  a  separate  effect  of  this  agent, 
apart  from  that  supported  by  cGMP  as  a  second  messenger.  This  effect  may  arise 
from  excitation  of  surrounding  neurons  presynaptic  to  the  one  recorded  or  from 
other,  direct  conductance  effects  of  acetylcholine  binding  at  the  neuronal 
receptors.  (Swartz  and  Woody,  J.  Neurobiol . .  1979;  Woody  at  al., 

Soc.  Neurosci .  Afastr. .  1979). 

8/  Tha  jaffacta  of  two  separate  unconditioned  stimuli  (US)  on  cortical 

QflAuana  j ma  atutfiati- 

a.  Behavioral  US  (glabella  tap) 


The  excitability  of  cortical  neurons  to  intracellularly  injected  current 
(depol.,  IQ  ms,  10  Hz  pulses)  was  compared  in  cats  given  US  alone  in  training 
and  testing  versus  cats  given  auditory  stimuli  (click)  and  cats  given  US  in 
training  but  not  in  testing.  There  were  no  differences  in  neural  excitability 
in  the  latter  2  groups,  but  less  current  was  required  to  discharge  cells  in  cats 
given  US  during  training  and  testing.  Reference  to  additional  control  studies 
indicates  that  the  excitability  of  neurons  of  the  motor  cortex  to 
intracellular! y  applied  current  was  transiently  increased  by  US  presentation. 

The  effects  of  US  presentation  on  unit  discharge  were  also  assessed  (Table 
I).  The  predominant  effect  of  US  delivery  on  cortical  neurons  was  IPSP 
production  and  a  reduction  in  rates  of  discharge;  however  on  Day  2  of  US 
presentations,  significant  increase  was  observed  in  the  numbers  of  cells 
responding  with  increased  rates  of  discharge  to  US  delivery. 

Thus,  evidence  has  been  found  for  three  US  effects:  1)  a  transient 
increase  in  intracellular  excitability  lasting  hours  or  days  but  not  weeks,  2)  a 
decrease  in  extracellular  excitability  of  unknown  duration  and  3]  an  increase  in 
the  numbers  of  cells  activated  to  discharge  by  the  US  from  Day  1  to  2  of  serial 
US  presentation.  (Brons,  J.,  Doctoral  Thesis,  UCLA,  1979). 

b.  Antidromic  JJ3 

Antidromic  stimulation  of  the  pyramidal  tract  has  been  used  successfully  as 
a  US  to  produce  conditioned  learning  [O'Brien  et  al.,  1977).  Effects  of  law 
frequency  4-6  Hz  FT  stimulation  (stereotax  cord:  F  3.5,  L  4.0,  H  4.S)  on 
cortical  neurons  were  Investigated.  Cortical  cells  activated  anti droml cal ly 
responded  predominantly  with  reduced  excitability  to  Intracellularly  applied 
current.  Cortical  cells  activated  transsynaptical ly  responded  with  Increased 
Intracellular  excitability.  Those  cells  falling  to  respond  showed  no  change  in 
excitability  during  the  5-15  minutes  tested.  (Tzebellkos  and  Woody, 

Brain.  Bat.  .Bulk.  1979). 

A  comparison  of  these  results  with  those  of  high  frequency  stimulation 
(usually  >  50  HZ)  reported  by  Bindman  et  al .  ( J.  Physiol , .  1979)  is  shown  in 

Table  II.  As  Indicated,  the  direction  of  change  is  frequency  dependent  and 
differs  between  anti droml cal  I y  and  transsynaptical ly  activated  units. 


TABLE  I 


Percent  of  cells  responding  with  increesed  discharge  (E),  decreased 
discharge  (I)  or  failing  to  respond  (UR)  to  glabella  tap  US  on  days 
1  and  2  of  repeated  US  presentations.  Numbers  of  cells  tested  (nj 
are  shown  to  the  right. 


E 

I 

UR 

n 

Day  1 

29% 

36% 

35% 

55 

Day  2 

*55% 

27% 

18% 

73 

♦difference  significant,  Chi  sq.  p  <.025 
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TABLE  II 


Comparison  of  affects  of  high  and  low  frequency 
FT  stimulation  on  cortical  neural  excitability. 


Low  Frequency  (Woody) 

Antidromical  ly  activated: 

T ranssynapti ca I  I y  acti vated : 
Unresponsive: 


exci tabi l ity  + 
exci tabi I ity  + 
no  change 


High  Frequency  IBindman,  et  alj 

Anti dromi cal ly  activated:  exci tabi I i ty  + 

Transsynaptical ly  activated:  exci tabi l i ty  + 


Numbers  of  cells  responding  to  low  frequency 
stimulation: 


Excitability  + 

Antidromic  14 

Transsynaptic  6 

Unresponsive  1 


Excitability  + 

9 

21 

2 


No  change 
11 
15 
37 
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31:  63-70,  1978. 

15.  Tzebelikos,  E.  and  Woody,  C.D.  Intracel lularly  studied  excitability  changes  in 
coronal-pericruciate  neurons  following  low  frequency  stimulation  of  the 
cortobulbar  tract.  Brain  Res.  Bull.  4:  635-641,  1979. 

16.  Swartz,  B.E.  and  VJoody,  C.D.  Correlated  effects  of  acetylcholine  and  cyclic 
guanosine  monophosphate  on  membrane  properties  of  mammalian  neurocorti cal 
neurons.  Jj.  Neurobio  1 .  10  :  465-488,  1979. 

17.  Woody,  C.O.,  Sakai,  H.v  Swartz,  B.,  Sakai,  M. ,  and  Gruen,  E.  Responses  of 
morphologically  identified  mammalian,  neocortical  neurons  to  acetylcholine 
(ACh),  aceclidine  (Acec)  and  cyclic  GMP  (cGMP).  Soc.  Neurosci .  Abstr.  5:  601, 
1979. 

18.  Kim,  H-J.  and  Woody,  C.D.  Facilitation  of  eye-blink  conditioning  by  hypothalmic 
stimulation.  Soc.  Neurosci .  Abstr.  5:  319,  1979. 

19.  Brons,  J.  and  Woody ,  C.D.  Changes  in  responsiveness  to  glabella  tap  among 
neurons  in  the  sensorimotor  cortex  of  awake  cats.  Soc.  Neurosci .  Abstr.  5:  314, 

1979. 

20.  Sakai,  H.  and  Woody,  C.D.  Identification  of  auditory  responsive  cells  in  the 
coronal-pericruciate  cortex  of  awake  cats.  Jj.  Neuroohvsiol .  44:  223-231,  1980. 

21.  Nahvi ,  M.J.,  Woody,  C.D.,  Tzebelikos,  E. ,  and  Ribak,  C.E.  El ectrophysiol ogi cal 
characterization  of  morphologically  identified  neurons  in  the  cerebellar  cortex 
of  awake  cats.  Exo.  Neurol .  67:  368-376,  1980. 

22.  Ribak,  C.E.,  Woody,  C.D.,  Nahvi,  M.J.,  and  Tzebelikos,  E.  Ul trastructural 
identification  of  physiologically  recorded  neurons  in  the  cat  cerebellum.  Exp. 
Neurol.  67:  377-390,  1980. 

23.  Brons,  J.F.  and  Woody,  C.D.  Long-term  changes  in  excitability  of  cortical 
neurons  after  Pavlovian  conditioning  and  extinction.  Jj.  Neurophysiol .  44: 
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24.  Woody,  C.D.  and  Gruen,  E.  Effects  of  cyclic  nucleotides  on  morphologically 
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1980. 

25.  Woody,  C.D.,  Ribak,  C.E.,  Sakai,  M.,  Sakai,  H.,  and  Swartz,  B.  Pressure 
microinjection  for  the  purposes  of  cell  identification  and  subsequent 
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CURRICULUM  VITA 


Name:  Charles  Dillon  Woody 


[Pll  Redacted] 


Education: 

1957  -  A.B.  Princeton  University 

1962  -  M.D.  Harvard  Medical  School  (Magna  Cum  Laude) 

Positions  Held: 

1977  -  Professor,  Anatomy,  Psychiatry  and  Biobehavioral  Science, 

UCLA  (in  Residence) 

1982  (summer)  Research  Scientist,  Marine  Biological  Laboratory,  Woods  Hole, 
Massachusetts 

1976  -  1977  Associate  Professor  in  Residence  of  Anatomy  and  Psychiatry-, — 
University  of  California  at  Los  Angeles 

1971  -  1976  Associate  Professor  in  Residence  of  Anatomy,  Physiology,  and 
,  Psychiatry , “University  of  California  at  Los  Angeles 

1968  -  1971  Research  Officer  (permanent).  Laboratory  of  Neural  Control, 
NINDS,  NIH,  Bethesda,  Maryland 

1967  -  1968  Harvard  Moseley  Fellow  with  Dr.  Jan  Bures,  Institute  of 

Physiology,  Czechoslovakian  Academy  of  Sciences,  Prague, 
Czechoslovakia 


1964  -  1967  Research  Associate,  Laboratory  of  Neurophysiology,  NIMH,  NIH, 
Bethesda,  Maryland 

1963  -  1964  Research  Fellow  in  Neurology,  Harvard  Medical  School, 

Resident  in  Neurology,  Boston  City  Hospital,  Boston 


1962  -  1963  Intern  in  Medicine,  Strong  Memorial  Hospital,  University  of 
Rochester,  Rochester,  New  York 


1960  -  1961  NIH  Post-sophomore  Research  Fellow  at  Stanley  Cobb 

Laboratory,  Massachusetts  General  Hospital,  Harvard  Medical 
School,  Boston 


1959  (summer)  Research  Assistant,  Communications  Biophysics  Group, 
Massachusetts  Institute  of  Technology,  Cambridge, 
Massachusetts 
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Honors  and  Fellowships: 

Leon  Resnick  Prize  for  promise  in  research.  Harvard  Medical  School,  1962 
Moseley  Fellowship  (Harvard  Medical  School),  1967-1968 

Nightingale  Prize  (Biol.  Engng.  Soc.  and  Internat.  Fed.  Med.  Biol.  Engng.  for 
best  paper  -  International  Journal:  Med.  Biol.  Engng.  1966-1968)  1969 
Honorary  Member,  Pavlovian  Institute,  U.S.S.R.,  1972 
Representative  of  Society  for  Neuroscience  to  Physiological  Reviews 
Member,  Brain  Research  Institute,  and  Mental  Retardation  Research  Center,  UCLA 
Member,  Neuroscience  Committee  supervising  the  UCLA  Medical  Center  Graduate 
Program  in  Neuroscience 

Bing  Fellowship  (Natl.  Acad.  Sci.)  -  Visiting  scientist  to  USSR  and 
Czecho  s lovakia ,  1972 

Chairman,  Session  on  "Brain  and  Behavior",  FASEB  Annual  Meeting,  1973 
Chairman,  Session  on  "Behavior  and  Conditioning",  International  Congress  of 
Physiological  Science,  New  Delhi,  1974 
Invited  Research  Scientist  and  Lecturer  at  Kyoto  University  Primate  Center, 
Japan;  sponsored  by  Japan  Society  for  the  Promotion  of  Science,  1975 
Chairman,  Session  on  "Behavior  and  Neuroethology",  FASEB  Annual  Meeting,  1977 
Invited  Panelist,  Session  on  "Association  Systems  and  Sensorimotor 
Integration",  International  Physiological  Congress,  Paris,  1977 
Chairman,  Session  on  "Neurotransraitters",  Soc.  for  Neuroscience,  October, 

1979. 

Exchange  Fellowship  (National  Academy  of  Science),  Prague,  1979. 

Consultant  to  Publications  Committee,  American  Physiologic  Society,  1980. 

Grant  Proposal  Reviewer,  NSF,  NIH,  ADAMHA,  NIMH 
Consultant  Biopsychology  Study  Section,  NIMH,  1981 

^Editorial  Service  and  Research  Consulting: 

Member,  Editorial  Board,  Physiological  Reviews  1974-1980 
Editor,  Soviet  Research  Reports.  UCLA  Brain  Information  Service 
Member,  Editorial  Board,  Brain  Research  Bulletin 
Member,  Editorial  Board,  Neuroscience  and  Behav.  Physiol. 

Member,  Board  of  Editorial  Commentators,  Current  Commentary  in  Behavioral  and 
Brain  Sciences 

Member,  Editorial  Board,  Neural  Systems: 

Structure.  Function  and  Transformation 
Reviewer  for:  EEG.  Clin.  Neurophvsiol. .  Phvsiol.  Behav.. 

J.  Comp.  Phvaiol.  Psvchol..  Behav.  Biol. .  J.  Neurophvsiol..  Exper .  Neuro 1 . . 
Brain  Res..  Exp.  Brain  Res..  Science.  Grant  Proposals  for  National  Science 
Foundation  and  NIH. 

Site  Visitor  at  Irvine  Medical  Center  for  Extramural  Research  Branch  NIAAA. 
Reviewer,  National  Institute  of  Mental  Health,  Basic  Psychopharmacology  and 
Neuropsychology  Research  Review 
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CURRICULUM  VITA 

Name:  Nahum  Allon 


[Pll  Redacted] 


{ 

I 


Present  Address:  Israel  Institute  of  Biological  Research 

Ness  Ziona  70450  ISRAEL 


1963-1966: 

1967-1970: 

1970-1973 


1974-1979: 


1979-1982 


1983- 

Recent  Research: 


Military  Service  as  an  officer 
B.Sc.  in  Biology,  Tel  Aviv  University 

"Studies  on  venom  synthesis,  secretion  and  injection  in 
viperid  snakes"  M.Sc.  thesis  under  the  supervision  of 
Prof.  £•  Kochva,  in  the  Department  of  Zoology,  Tel  Aviv 
University 

"Neural  activity  in  the  medial  geniculate  body  of 
squirrel  monkey  (Saimiri  sciureus)  in  response  to 
auditory  stimuli"  Ph.Da  thesis  under  the  supervision 
of  Dra  Z.  Wollberg  in  the  Department  of  Zoology,  Tel 
Aviv  University 

• 

Assistant  Research  Psychophysiologist 
Neuropsychiatric  Institute,  UCLA 
Supervisor:  CaDa  Woody,  MaD. 

Israel  Institute  of  Biological  Research 

1.  Changes  in  excitability  of  units  in  cat  pericruciate 
cortex  to  weak  extracellular  stimulation  during 
conditioning 

2.  The  ionic  mechanism  underlying  the  excitation  of 
cells  in  the  motor  cortex  by  weak  extracellular 
currents 


PUBLICATIONS: 

Allon,  N.  and  Kochva,  E.  (1972)  Amount  of  venom  injected  into  mice  and  rats  by 
Vipera  oalaestina  in  a  single  bite*  Am.  Zool,  12:685. 

Kochva,  E«,  Oron,  U. ,  Bdolah,  A.,  and  Allon,  N.  (1972)  Regulacao  da  secrecao  e 

injecao  de  venamo  em  sepentes  viper ideos.  Simposio:  "Aplicacao  de  venenos 
das  serpentes  em  Problemas  de  Farmacologia  e  Bioquimica  cellular".  Ribeirao 
Preto  S.Pa  Brazil. 
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Allon,  N.  and  Kochva,  E.  (1974)  The  quantities  of  venom  injected  into  prey  of 
different  sizes  by  Vipera  palaestina  in  a  single  bite,  Jj_  Exp,  Zool. 
188:71-76. 

Kochva,  E.f  Oron,  U,,  Bdolah,  A.,  and  Allon,  N.  (1975)  Regulation  of  venom 
secretion  and  injection  in  viperid  snakes.  Toxikon  13:104. 

Allon,  N.  and  Wollberg,  Z.  (1978a)  Superior  colliculus  of  squirrel  monkey: 

Responses  of  single  cells  to  auditory  stimuli.  Abstract  presented  in  the 
Israel  Society  of  Physiology  and  Pharmacology. 

Allon,  N.  and  Wollberg,  Z.  (1978b)  Responses  of  cells  in  the  medial  geniculate  body 
(MGB)  of  squirrel  monkey  to  auditory  stimuli.  Neurosci.  Ltrs.  Suppl.  1:52. 

Allon,  N.  and  Wollberg,  Z.  (1980)  The  response  properties  of  cells  in  the  medial 
geniculate  body  (MGB)  of  awake  squirrel  monkey  to  species  specific 
vocalization.  Soc.  Neurosci.  Abstr .  6:333. 

Allon,  N.,  Teshurun,  Y.,  and  Wollberg,  Z.  (1981)  Responses  of  single  cells  in  the 
medial  geniculate  body  of  awake  squirrel  monkey.  Exp.  Brain  Res , 

41:222-232. 

Yeshurun,  Y.,  Allon,  N.,  and  Wollberg,  Z.  (1981)  A  computer  aided  simulation  of  an 
electrode  penetration  into  deep  brain  structures.  Computers  and  Biomed. 

Res.  14:19-31. 

Brons,  J.F.,  Woody,  C.D.,  and  Allon,  N.  (1982)  Changes  in  the  excitability  to  weak 
intensity  extracellular  electrical  stimulation  of  units  of  the  pericruciate 
cortex  in  cats.  Neurophvsiol.  47:377-388. 

Allon,  N.,  and  Woody,  C.D.  (1982)  Initiation  of  paraoxysmal  depolarization  shifts 
in  single  cells  of  the  sensorimotor  cortex  of  awake  cats  by  scorpion  venom 
(Centruroides  sculpturatus) .  Soc .  Neurosci.  Abstr.  8:101. 

Allon,  N.,  and  Woody,  C.D.  Epileptiform  activity  induced  in  single  cells  of  the 
sensorimotor  cortex  of  the  cat  by  intracel lularly  applied  scorpion  venom 
(Centruroides  sculpturatus).  Exp.  Neurol..  1983,  in  press. 
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Curriculum  Vita 


Neil  E.  Berthier 


April  1983 


fPII  Redacted] 


II.  Educational  Background: 


A.  Attended  University  of  Massachusetts,  Amherst,  Ma.  from 
September  1975  to  November  1980.  M.S.  May,  1978,  Ph.D. 
February,  1981.  Psychology,  concentration  in  Neurobiology  of 
Learning  and  Memory,  Advisor  J.W.  Moore. 

B.  Attended  Virginia  Polytechnic  Institute  and  State  University, 
Blacksburg,  Va.  from  September  1971  to  March,  1975.  B.S.  June 
1975  with  Distinction  in  Psychology. 

C.  Graduate  Courses  Taken: 

#  Statistical  Inference  in  Psychology 
Physiological  Psychology 
Neuroanatomy 

Advanced  Applied  Statistics 
Conditioning 

Comparative  Neurophysiology 

Psy chopharmaco logy 

Animal  Learning 

Human  Information  Processing 

Neurobiology  of  Learning  and  Memory 

Developmental  Neurobiology 

Experimental  Neurophysiology 

Courses  Audited: 

Calculus  I,  II,  and  Multivariate  Calculus 

Minicomputers 

Neurochemistry 

D.  Student  in  the  January  1982  Neurobiology  course  at  the  Marine 
Biological  Laboratory,  Woods  Hole,  Ma. 


III.  Professional  Positions: 

A.  Assistant  Research  Neurobiologist,  January,  1981  to  present, 
Department  of  Psychiatry,  Mental  Retardation  Research  Center, 
Neuropsychiatric  Institute,  UCLA  Medical  Center,  Los  Angeles,  Ca 


L 


: 


J 


B.  Teaching  Assistant  and  Associate ,  September  1975  to  May  1980, 
University  of  Massachusetts,  Amherst  Ma.  Assisted  and  prepared 
exams  and  lectures  for  courses  in  Physiological  Psychology, 
Animal  Learning,  Statistics,  Methods,  and  Introductory 
Psychology. 

IV.  Professional  Specialties  and  memberships: 

Neurobiology  of  Learning  and  Memory,  Animal  Learning. 

.  Member  of  the  Society  for  Neuroscience 

V.  References: 

Dr.  J.W.  Moore,  Department  of  Psychology, 

University  of  Massachusetts,  Amherst  Ma.  01003 

Dr.  C.D.  Woody,  Departments  of  Psychiatry  and  Anatomy 

University  of  California  Los  Angeles,  Los  Angeles,  Ca.  90024 

Dr.  D.L.  Alkon,  Laboratory  of  Biophysics,  Marine  Biological 

Laboratory,  Woods  Hole,  Ma.  02543 

Dr.  G.A.  Wyse,  Department  of  Zoology, 

University  of  Massachusetts,  Amherst  Ma.  01003  __ 

•  VI.  Publications  and  Presentations: 

Berthier ,,  N.E. ,  Spinelli,  D.N.,  Solomon,  P.R.  &  Moore,  J.W. 

Fiber-sparing  lesions  of  the  central  nervous  system  produced  by 
cyanide.  Presented  by  Moore  at  the  European  Brain  and  Behavior 
Society's  workshop  on  the  Cerebral  Commissures.  Rotterdam,  March, 
1977. 

Moore,  J.W.,  Yeo,  C.  &  Berthier,  N.E.  Brain  mechanisms  of  Pavlovian 
inhibition.  Presented  at  the  Annual  meeting  of  the  Psychonomic 
Society,  San  Antonio,  1978. 

Powell,  G.M.,  Berthier,  N.E.  &  Moore,  J.W.  Efferent  neuronal  control 
of  the  nictitating  membrane  in  rabbit  (Oryctolagus  cuniculus):  A 
reexamination.  Physiology  &  Behavior,  1979,  23,  299-308. 

Berthier,  N.E.  &  Moore,  J.W.  Role  of  the  extraocular  muscle  in  rabbit 
(Oryctolagus  cuniculus)  nictitating  membrane  response.  Physiology 
&  Behavior,  1980,  24,  931-937. 

Berthier,  N.E.  &  Moore,  J.W.  Spatial  differential  conditioning  of  the 
nictitating  membrane  response  in  hippocampectomized  rabbits. 
Physiological  Psychology,  1980,  8,  451-454. 

Berthier,  N.E.  &  Moore,  J.W.  Disrupted  conditioned  inhibition  of  the 
rabbit  nictitating  membrane  response  following  mesencephalic 
lesions.  Physiology  &  Behavior,  1980,  25,  667-673. 
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Berthier,  N.E.  &  Moore,  J.W.  Multiple  unit  activity  of  the  abducens 
nerve  in  the  anesthetized  and  paralyzed  rabbit.  Society  for 
Neuroscience  Abstracts,  1980,  6,  427. 

Berthier,  N.E.,  Betts,  B.  &  Woody,  C.D.  Rapid  eyeblink  conditioning: 
response  topography.  Society  for  Neuroscience  Abstracts,  1981,  7, 
750. 

Desmond,  J.E.,  Berthier,  N.E.  &  Moore,  J.W.  Brains  stem  elements 
essential  for  the  classically  conditioned  nictitating  membrane 
response  of  rabbit.  Society  for  Neuroscience  Abstracts,  1981,  7, 
650. 

Moore,  J.W. ,  Berthier,  N.E.  &  Desmond,  J.E.  Brain  stem 

electrophysiological  correlates  of  the  classically  conditioned 
nictitating  membrane  response  in  rabbit.  Society  for  Neuroscience 
Abstracts,  1981,  7,  358. 

Moore,  J.W. ,  Desmond,  J.E.  &  Berthier,  N.E.  The  metencephalic  basis 
of  the  conditioned  nictitating  membrane  response.  In 
Conditioning:  Representation  of  Involved  Neural  Functions.  C.D. 
Woody  (Ed.),  New  York:  Plenum,  1982. 

Berthier,  N.E.,  Betts,  B.  &  Woody,  C.D.  Discrimination  corfditioning 
of  eyeblink  with  aversive  brain  stimulation.  Society  for 
Neuroscience  Abstracts,  1982,  8,  315. 

Berthier,  N.E.  &  Moore,  J.W.  The  unconditioned  nictitating  membrane 
response:  The  role  of  the  abducens  nerve  and  nucleus  and  the 
accessory  abducens  nucleus  in  the  rabbit.  Brain  Research,  1983, 
258,  201-210. 

Kim,  E.H-J.,  Woody,  C.D.  &  Berthier,  N.E.  Rapid  acquisition  of 

conditioned  eyeblink  responses  in  cats  following  pairing  of  an 
auditory  conditioned  stimulus  with  glabella  tap  unconditioned 
stimulus  and  hypothalamic  stimulation.  Journal  of 
Neurophysiology,  1982,  49,  767-779. 

Woody,  C.D.,  Kim,  E.H-J.  &  Berthier,  N.E.  Effects  of  hypothalamic 
stimulation  on  unit  responses  recorded  from  neurons  of  the 
sensorimotor  cortex  of  awake  cats  during  conditioning,  Journal  of 
Neurophysiology,  1982,  49,  780-791. 
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Name :  Dr.  Lynn  J.  Bindman  (nee  Winton) 

Address :  Department  of  Physiology 

University  College  London 
Gower  Street,  LONDON  WC1E  63T 


(Pll  Redacted] 


Education;  South  Hampstead  High  School  for  Girls,  London 

-  University  College  London.  Department  of  Physiology 

1957-1963 


Degrees :  BSc  London  1960  Class  Upper  13 

PhD  London  1964  Physiology  of  the  cerebral  cortex 

Posts  held:  Honorary  Research  Assistant,  Department  of  Physiology, 

l-CL,  Grant  awarded  by  Medical  Research  Council  1963-1965 

Assistant  Lecturer  (part-time)  Department  of  Physiology, 
UCL  1965-1969 


Research  Associate  (part-time)  Department  of  Physiology, 
UCL.  Grant  awarded  by  Medical  Research  Council  1969-1972 


Lecturer,  Department  of  Physiology,  UCL  1972- 


The  Physiological  Society  -  elected  1967 

Education  sub-committee  -  appointed  1981 
The  Pharmacological  Society  -  elected  1976 
International  Brain  Research 
Organisation 

Brain  Research  Association 


elected  1978 


PUBLICATIONS 
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Research: 


LIPPOLD,  O.C.J.,  REDFEARN,  J.W.T.  fc  WINTON,  L.J.  (1961).  The  potential 
level  at  the  surface  of  the  cerebral  cortex  of  the  rat  and  its 
relation  to  the  cortical  activity  evoked  by  sensory  stimulation . 

J.  Physiol.,  157,  7-9P 

BINDMAN,  L.J.,  LIPPOLD,  O.C.J.  &  REDFEARN ,  J.W.T.  (1961).  The  diffusion 
of  'y-amino  butyric  acid  within  the  mammalian  cerebral  cortex  and 
the  non-selective  nature  of  its  blocking  action.  J,  Physiol. ,  160, 
24-25P 

BINOMAN,  L.J.,  LIPPOLD,  O.C.J.  L  REDFEARN,  J.W.T.  (1962).  The  prolonged 
after-action  of  polarizing  currents  on  the  sensory  cerebral  cortex. 

J.  Physiol . ,  162 ,  45-46P 

BINDMAN,  L.J.,  LIPPOLD,  O.C.J.  k  REDFEARN,  J.W.T.  (1962).  Long-lasting 

changes  in  the  level  of  the  electrical  activity  of  the  cerebral  cortex 
produced  by  polarizing  currents.  Nature ,  196 ,  584-585 

BINDMAN,  L.J.,  LIPPOLD,  O.C.J.  k  REDFEARN ,  J.W.T.  (1962).  Variations  in 
evoked  potentials  and  potential  gradients  in  the  sensory  cortex. 

Proc.  XXII  Int.  Congr .  Physiol.  Sci.,  Leiden,  Sept.  10-17 

BINDMAN,  L.J.,  LIPPOLD,  O.C.J.  &  REDFEARN,  J.W.T.  (1962).  The  non-selective 
blocking  action  of  ’y-amino  butyric  acid  on  the  sensory  cerebral  cortex 
of  the  rat.  J .  Physiol . ,  162,  105-120 
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of  passive  avoidance  by  post-trial  injection  of  picrotoxin  into 
the  substantia  nigra  in  rats.  Neuroscience  Abstracts.  1975, 

Vol .  1 ,  pp  379. 
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Location:  Primate  Res.  Inst.,  Kyoto  University 
Supervisor:  K.  Kubota, 
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Chapter  7 

Cybernetics:  A  Means  for  Analysis  of 
Neural  Networks 


The  development  of  the  statistical  theory  of  communication  is  a  landmark 
in  the  history  of  communication  theory.  Our  primary  concern  in  a  com¬ 
munication  or  control  problem  is  the  flow  of  messages.  Since  the  central 
idee  in  the  statistical  theory  is  that  messages  and  noise  should  be  considered 
as  random  phenomena ,  the  theory  incorporates  probability  theory  and  gen - 
€ rallied  harmonic  analysis  m  its  foundation.  • 

(Y.  W.  Lee,  1960) 

Commonsense  approaches  to  an  understanding  of  “higher  function**  are  use¬ 
ful  but,  as  we  have  seen,  are  basically  introspective.  Such  approaches  could  be 
ill  advised  if  used  analytically  because  of  their  intrinsic  susceptibility  to  errors, 
particularly  those  of  the  type  illustrated  in  Fig.  6.6.  Other,  more  objective 
means  must  be  found  to  analyze  the  complex  integrative  functions  of  neural 
networks.  As  our  knowledge  of  anatomically  and  physiologically  based  mem¬ 
ory  and  learning  advances,  so  must  our  expression  of  this  knowledge.  The 
form  of  this  improved  expression  is  likely  to  be  mathematical  and  as  specific 
as  expression  of  our  modem  knowledge  of  genetics  and  the  genetic  codes. 
The  purpose  of  this  chapter  is  to  explore  some  of  the  forms  that  are  likely  to 
serve  for  expression  of  our  knowledge  of  memory  and  learning. 

Analysis  of  large  populations  of  neurons  can,  in  principle,  be  approached 
from  the  same  standpoint  as  analysis  of  numerically  small  refiex  networks. 
The  analysis  requires  application  of  systems  approaches  from  engineering 
disciplines  plus  consideration  of  the  limiting  physiologic  constraints  that 
apply  to  each  system  analyzed.  In  addition,  since  large  populations  of  neurons 
deal  substantially  with  the  processing  of  m formation,  their  overall  analysis 
requires  concepts  from  information  theory. 

This  concluding  chapter  examines  possible  means  for  analyzing  complex 
systems  using  mathematics,  engineering,  and  physics.  The  approach  is  called 
systems  analysis,  but  when  applied  to  adaptive  systems,  it  is  more  properly 
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termed  cybernetics,  the  analytic  science  that  deals  with  the  control  of  infor¬ 
mation  processing  in  man  and  machine.  By  using  the  techniques  described 
herein,  a  rigorous  analysis  can  be  made  of  linear  information  processing 
systems  and,  perhaps,  of  some  nonlinear  systems  as  weil  [582,583,1086]. 
Some  reflexes  within  the  brain  can  be  assumed  to  behave  as  a  linear  system 
•  and  can  be  investigated  by  linear  systems  analysis  [429,1123].  Such  an 
analysis,  though  properly  applicable  only  to  theoretical  systems  meeting  strict 
statistical  criteria,  still  provides  the  most  useful  beginning  toward  a  ngorous 
analysis  of  complex  nerve  networks.  It  simplifies  the  complexities  of  the  net¬ 
works,  leads  to  formulations  of  the  transforms  of  given  inputs  into  particular 
outputs,  and  generates  more  precise  transforms  than  those  presently  existing. 

A  few  suitable  models  of  information  transfer  in  the  brain  have  been  de¬ 
veloped  that  are  amenable  to  mathematical  analysis  [cf.  18-22,366,838*841, 
883,1033-1038] .  The  most  elegant  of  these  deals  with  image  recognition,  i.e. 
the  transmission  and  processing  of  sensory  labeled  messages  arising  at  the 
receptors.  Minsky  and  Papert  [672]  have  transformed  certain  problems  of 
image  recognition  into  problems  of  geometry-a  transformation  that  elegantly 
simplifies  many  problems  of  analysis.  Then,  they  have  devised  a  theorem,  the 
Group  Invariance  Theorem,  that  provides  a  general  analytic  solution  for  one. 
set  of  the  geometry.  In  application,  the  Group  Invariance  Theorem  (p.  388) 
adequately  describes  the  geometry  of  sensory  reception  for  the  components 
of  two  specific  models  of  elements  of  an  image  recognition  network,  the  per- 
ceptron  and  the  informon.  In  these  models,  as  in  the  brain  itself,  line  labeling 
appears  to  be  the  key  to  following  the  flow  of  information  through  its  com¬ 
plex  transformation  from  sensory  input  into  motor  output.  Flowgraphs  and 
linear  systems  analysis  are  also  helpful  in  this  regard. 

Each  of  these  analytic  approaches  properly  begins  by  considering  known 
constraints  on  the  system  to  be  analyzed.  Therefore,  before  discussing  the 
models  and  their  analysis,  some  constraints  on  information  processing  that 
any  useful  model  of  brain  function  should  satisfy  will  be  considered 


Constraints 

Time  Constants  of  Neural  Information  Flow 

How  rapidly  can  information  be  transmitted  and  processed  within  the  CNS? 
Conduction  Time  and  Transmission  Delay 

As  noted  earlier  in  Chapter  2,  the  rate  of  nerve  conduction  is  a  function  of 
fiber  size,  with  large  axons  conducting  more  rapidly  than  small  axons.  Trans¬ 
mission  of  an  electrically  propagated  impulse  along  a  neuron  may  proceed  as 
rapidly  as  160  m/sec  in  the  dorsal  spinocerebellar  tract  of  the  cat  [369]  or  as 
slowly  as  0.5  m/sec  in  the  finest,  unmyelinated  axons  of  the  spinothalamic 
system  [693] .  Thus,  while  it  could  take  as  little  as  2  msec  for  proprioceptive 
information  concerning  hindleg  position  to  reach  the  cerebellum  of  the  cat 
(a  distance  of  about  320  mm),  it  could  take  as  long  as  640  msec  for  infor- 
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Automata  Design 


I 


H.  Spatial  signal-sarial  processor-temporal  coda 


A,B  d 


at  d: 


1 - =  (A) 

—  I  —  =  (D> 

- I  *  (B) 


but  than: 


III.  Spatial  signal-parallel  processor-Spatial  coda 


A,B 


*s 

8D 


3B 

1A 

ID 


>  d  i 


0 

es; 


2B 

20 


3: 


Discriminates  B,  but  not  A,  D 


Discriminates  A,  B,  D  and  survives 
ablation  of  any  1  of  3  inputs  to  t-j 


*  eM 


1: 


Discriminates  A,  B,  D  and  survives 
ablation  of  any  1  of  3  inputs  to  a^ 
and/or  #2 


Fif.  7.5.  Examples  of  the  components  of  different  automata.  I.  Receptor  ele¬ 
ments  common  fo  each  example.  The  uppermost  of  the  four  elements  is  re¬ 
ceptive  to  ( and  intersected  by)  the  letters  A  and  B  but  not  D.  The  lowest  ele¬ 
ment  is  receptive  to  B  only .  77ie  receptivity  of  the  remaining  two  elements  is 
as  indicated .  IHV.  Automata  with  different  network  architectures :  If  serial 
time  dependent f  ///,  parallel  perceptron,  IV,  parallel  pandemonium.  In  II  three 
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IV.  Faaturt  weighting  and  analysis  plurfaadback  control 


Wuipiw  Out  *wiyw»  liiliyilwfc 


V.  Feature  detection  and  evolution 


*2»  are  various  analytic  operators: 
e.Q„  template  matching,  summing, 
differentiating,  etc. 


Selection  is  based  on 
the  sum  Wf  of  the 
weightings  If  of  the  *j 
individual  features  analyzed 


different  coded  outputs  of  the  decisionai  element ,  d,  ore  shown  to  the  right. 
Below,  the  ambiguity  of  this  coding  is  illustrated  when  its  beginning  in  time  is 
uncertain.  In  III  changing  6.  the  number  of  inputs  required  to  fire  the  second 
order  elements,  changes  the  discriminative  property  of  the  network  as  dis¬ 
cussed  in  the  text  and  summarized  in  the  diagram  to  the  right.  In  IV  a  variation 
on  HI  introducer  feature  detection  (e.g„  summation,  filtering,  etc.)  as  well  as 
feedback  control  (heavy  dashed  line)  into  the  circuit.  A  version  of  IV  is 
shown  below  (V)  in  which  details  have  been  inserted  after  Self  ridge’s  pande¬ 
monium  [883 f.  Selection  of  evaluation  of  the  individual  demons  for  permu¬ 
tation  is  based  on  W^,  the  sum  of  the  weightings,  Xj,  of  the  individual  feature 
detectors*  ij. 

The  filled  circles  represent  serial  time  delay  elements.  The  elements  com- 
prised  by  dashed  lines  represent  a  clocking  mechanism  that  keeps  track  of 
time  following  presentation  of  the  stimulus  pattern  at  the  receptors. 
Depending  on  which  receptor  is  activated,  a  time  coded  signal  1—,  •!*,  or 
—1  will  be  generated  at  the  decision-making  element,  d.  Note  that  if  track 
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il  not  kept  of  time  (see  Fig.  7.5,  II,  lower  right),  the  code  becomes  am¬ 
biguous.  Though  the  example  is  oversimplified,  it  is  quite  representative  of 
the  type  of  processing  that  is  widely  used  in  digital  computers. 

The  term  parallel  processing  was  originally  used  to  designate  performance 
of  the  same  processing  operation  by  more  than  one  channel  at  a  time.  The 
purpose  was  to  support  majority  logic  and  redundant  signal  processing  as  dis¬ 
cussed  earlier. Multiplexed,  parallel  processing  resembles  much  of  the  process¬ 
ing  done  by  the  brain.  In  the  example  shown  in  Fig.  7  J,  III,  the  second-order 
elements  receive  redundant  messages  and  parallel  processing  is  used  to  gener¬ 
ate  a  “decisional'’  output  at  element  “d’\  As  can  be  seen,  this  type  of  pro¬ 
cessing  has  remarkable  sorting  or  discriminative  properties  when  adaptation  is 
introduced. 

If  each  of  the  second  order  elements  in  Fig.  7.5  III  is  set  to  fire  when  three 
inputs  axe  received  (3/3),  the  network  wifi  distinguish  B,  but  not  A  from 
D,  i.e.,  ix  (fires)  =  B.  If  the  “threshold*'  is  reduced  to  discharge  upon  re¬ 
ception  of  two  inputs  (2/2),  the  network  wifi  then  discriminate  A,  B.  and 
D.  An  A  will  be  designated  by  no  discharge,  a  B  by  discharge  of  both 
elements,  and  a  D  by  discharge  of  the  lower  chmcnit  Le.,  Tt  a~2  =  A  (or 
nothing  presented),  =  B,  Fja2  *  D.  Moreover,  the  network  wifi 
continue  to  function  despite  destruction  of  any  one  of  the  three  input 
lines  to  the  upper  element. 

Although  one  must  beware  of  making  exact  transpositions  between 
mechanical  and  physiologic  models,  many  of  the  same,  general  theoretical 
considerations  concerning  learning,  memory,  and  even  higher  function  apply 
to  machines  as  to  physiologic  systems.  The  machines  give  us  a  physical  model 
which  is  more  accessible  to  analysis  and  is  more  easily  studied.  Three  machine 
automata  stand  out  from  the  others  in  providing  insightful  models  of  learning 
operations,  component  interactions,  and  the  constraints  thereof.  They  arfe  the 
perceptron,  pandemonium,  and  the  informoa. 

Perceptron 

The  perceptron  represents  an  early  attempt  by  Rosenblatt  and  colleagues  to 
develop  a  learning  automaton  based  on  their  conceptions  of  brain  organiza¬ 
tion  [838-841].  In  this  device,  the  components  consist  simply  of  modifiable 
elements  and  their  interconnections.  As  shown  in  Fig.  726,  a  is  the  sum  of 
the  components  each  weighted  by  a ^  When  the  weightings  are  modified 
(Aa),  the  system  can  adapt  to  distinguish  a  particular  input,  identified  when 
i?  is  >  some  predetermined  value,  0. 

**2«**<X)>*1,  (7.2) 

where  Aa  reflects  adaptation. 

The  example  of  parallel  processing  (Fig.  7.5,  III)  can  be  viewed  as  a  per- 
ceptron  by  making  d  *  2  and  considering  aL  and  as  having  weighted  inputs 
depending  on  the  threshold  settings,  0V 
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In  such  systems,  the  performance  of  pattern  recognition  can  be  adaptively 
improved  with  relatively  simple  algorithms  of  element  modification  as  illus¬ 
trated  in  Fig.  7.5  (additional  algorithms  are  listed  on  p.  395).  Although  this 
can  be  done  among  elements  with  randomly  organized  connections,  as  the 
original  perception  demonstrated,  a  more  efficient  operation  will  be  provided 
by  a  nonrandomly  organized  network.  Thus,  the  organization  of  the  adaptive 
network  may  become  a  critical  variable  in  the  learning  operations  that  are 
performed  by  such  a  system. 


Pandemonium 

An  example  of  a  nonrandomly  organized  automaton  is  pandemonium  of 
Oliver  Selfridge  [883].  Its  organization  is  hierarchical,  being  characterized 
by  multiple  layers  supporting  different  operations  as  shown  in  Fig.  7.5,  IV 
and  V.  The  initial  layer  again  consists  of  simple  receptor  or  data  collecting 
elements,  termed  data  demons  by  Selfridge.  The  second  layer  consists  of 
specialized  analyzers  or  computational  demons.  They  process  incoming  data 
by  stereotyped  procedures  such  as  matched  filtering,  summation,  or  differen¬ 
tiation.  The  third  layer  consists  of  integrators  or  cognitive  demons.  They  inte^ 
grate  weighted  inputs  from  various  computational  demons.  Finally,  a  decision 
maker  or  “decision  demon^  selects  the  loudest  or  most  active  cognitive 
demon(s)  and  by  its  (their)  identity  gives  prionty  to  a  selected  set  of  receptors. 

Within  th»-hierarchy,  adaptation  occurs  according  to  ruies  of  reinforce¬ 
ment  specified  in  terms  of  the  effectiveness  of  each  element  in  performing  the 
selected  recognition  task.  Elements  which  are  more  contributory  to  successful 
image  recognition  are  positively  reinforced  by  increasing  their  weighting.  Ele¬ 
ments  which  are  less  contributory  are  eliminated.  Permutations  of  the  analy¬ 
tic  algorithms  of  successful  elements  are  generated  to  replace  those  of  unsuc¬ 
cessful  elements.  Hill -climbing  techniques  are  used  to  secure  continued  im¬ 
provements  of  the  adaptations  with  extensive  attention  paid  to  the  problem 
of  avoiding  false  peaks. 

Several  insights  into  adaptive  information  processing  are  provided  by  pan¬ 
demonium.  Pandemonium  is  characterized  as  a  chaotic  operation  with  demons, 
subdemons,  and  sub-subdemons  shrieking  their  outputs,  adapting,  deciding, 
and  sometimes  evolving.  However,  the  chaos  turns  out  to  be  more  orderly  than 
expected.  All  the  analytic  functions  are  particularized  and  are,  to  a  significant 
degree,  predetermined.  Despite  the  great  degree  of  adaptability  within  the 
hierarchy,  the  hierarchy  is  relatively  fixed.  The  reason  for  this  is  that,  al¬ 
though  the  adaptability  permits  evolution,  it  is  along  a  predictable  pathway, 
and  occurs  within  a  particular  hierarchy.  (This  feature  appears  to  have  led 
this  particular  automata  to  a  particularly  tenacious  pursuit  of  false  peaks 
during  hill-climbing  adaptive  operations.)  Differences  in  the  design  of  the 
hierarchy  selected  for  Pandemonium  versus  that  shown  in  Fig.  3.42  may 
therefore  be  of  some  consequence.  The  ability  to  switch  between  elements 
may  need  to  be  matched  by  an  ability  to  switch  between  hierarchies. 
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Infonnon 

The  informon  model  of  Uttley  [1033-1038)  takes  a  somewhat  different 
approach  to  the  design  of  an  automaton,  concentrating  on  improving  the 
construction  of  the  fundamental  adaptive  element  itself.  The  basic  informon 
consists  of  a  single  element  with  multiple  inputs  F(x„)  and  an  output  (Fig. 
7.6).  The  inputs  have  variable  weightings,  a.  One  of  the  inputs  is  defined  as  a 
reinforcing  input  F(z)  with  a  fixed  negative  weighting,  -k.  There  is  also  pro¬ 
vision  for  negative  feedback  of  information  concerning  the  operational  state 
of  the  element,  F(Y).  The  negative  feedback  is  required  for  stability  of  the 
adaptive  process.  F(Y)  is  some  function  of  the  output  of  the  element  prior  to 
the  state  of  binary,  spike  discharge.  There  is  finally  a  threshold  device,  6 ,  at 
or  just  before  the  output,  which  can  be  used  to  discriminate  between  different 
sets  of  inputs. 

Several  additional  variables  (or  constraints)  are  required  for  the  informon 
to  discriminate  successfully  one  particular  input  F(X()  from  another, F(xtf). 
These  are: 

1 .  The  algorithm  by  which  af*  is  altered  (A  a). 

2.  The  need  for  a  reinforcing  input,  F(z),  to  distinguish  or  identify  which  in¬ 
put  signal  is  the  particular  signal  to  be  discriminated. 

3.  The  need  to  achieve  some  system  normalization  through  ne^tive  (not 
positive)  feedback  of  information  regarding  the  cuuent  system  state, 

W 

STote  also  that  by  picking  the  adaptive  algorithm  correctly  (e.g.,  log  of  the 
mutual  information  between  inputs),  one  can  greatly  facilitate  both  normali¬ 
zation  and  input  discrimination. 

Algorithm  for  Act 

The  trick  here  is  to  choose  an  algorithm  that  will  produce  S-shaped  adaptive 
operations  such  as  are  found  with  conditioning  or  other  simple  forms  of 
learning.  It  will  also  be  useful  to  have  a  decay  or  extinction  phase  of  adap» 
tation.  Adaptation  is  performed  by  changing  the  weighting,  a,  of  an  input. 

Simple  Informon 


Fig.  7.6.  The  basic  informon  element.  See  text  for  further  details.  (After 
Uttley  [1038}.) 
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Figure  7.7  shows  such  an  operation  graphically  and  enables  us  to  see  how  a 
particular  choice  of  algorithm  may  or  may  not  produce  a  stable  change  in 
weighting. 

Uttley  points  out  that  analysis  in  the  phase  plane  between  change  in 
a(Le.,  Aa)  and  a  itself  reveals  the  limitations  of  certain  algorithms,  notably 
those  proposed  by  Hebb  [397]  and  by  Brindley  [97]  and  Marr  [646] .  This  is 
shown  in  Fig,  7.8. 

Hebb’s  postulate  that  an  input  causes  an  increased  output  simply  indi¬ 
cates  that  if  a  is  positive  so  must  be  Act  This  postulate  places  the  algo¬ 
rithm  for  acquisition  within  the  right  upper  quadrant  (++)  of  Fig.  7.8,  but 
‘  fails  to  specify  a  relationship  or  slope  between  variables  Aa  and  a.  Brindley 
[97]  and  Mart  [646),  in  effect,  consider  a  pathway  with  two  states,  one 
initial  and  one  final,  in  which  Aa  and  a  increase  together.  With  limiting 
values  this  reduces  to  an  all-or-none,  two  state  process.  Without  limiting 
values  this  represents  an  unstable  system  with  positive  feedback  which  will 
lead  to  regenerative  explosion  (line  “a”  in  Fig.  7.8).*  Uttley  picks  an 
algorithm  which  allows  the  values  of  Aa  and  a  to  fluctuate  in  the  manner 
shown  by  lines  M b ”  and  “c"  of  Fig.  7.8  [  1036] . 

System  Normalization  by  Feedback  of  System  State 

Uttley  points  out  that  regenerative  explosion  may  be  avoided  by  introducing 
a  normalization  process,  such  as  that  of  Malsburg  [1047].  However,  Mals- 
burg’s  type  of  norm  Nation  shows  an  overly  restrictive  range  of  successful 

.  Adaptation  in  an  Informon 


Stable  e  Unstable 


Fig.  7.7.  Adaptation  in  an  informon  involves  changes  in  a,  the  weightings  of 
input ;  over  time.  In  the  example  to  the  left  an  increase  in  a  occurs  during  ac¬ 
quisition  of  input  facilitation  and  a  decrease  occurs  during  its  extinction  or 
defacilitation.  The  parallel  between  this  and  conditioned  behavior  is  deliberate. 
In  the  example  to  the  right  acquisition  is  an  unstable  process  with  a  declining 
unintentionally  past  a  certain  transition  point.  This  may  occur  because  of  fail¬ 
ure  to  regulate  the  system  state  appropriately  during  the  adaptive  process  See 
text  for  further  details  about  regulating  the  system  state  ( After  Uttley  [ 1036 /  J 


•This  problem  is  avoided  in  some  nonlinear  systems  that  change  state  as  levels  reach  cer¬ 
tain  limits. 
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Phase  Plane  Between  Act  and  a 


Fig.  7.8.  Phase  plane  of  a  versus  change  in  a  (Le.f  Aa).  State  changes  along 
“a"  such  as  those  proposed  by  Marr  [646 J  and  Brindley  [97)  are  unstable , 
while  those  along  "b  "or  "c”are  not.  b  mirrors  the  state  change  during  acqui¬ 
sition  in  Fig.  7. 7;  ‘V'  mirrors  the  state  change  during  extinction.  (After  Uttlcy 
(10361.) 


operation  when  applied  to  a  system  with  positive  feedback.  To  avoid  this, 
Uttiey  turns  to  negative  feedback  as  shown  in  Eq.  73b.  Thus,  the  adaptation 
of  his  element,  and  probably  some  neuronal  elements  as  well,  depends  critical* 
ly  on  negative  feedback  of  information  concerning  the  system  state,  F(Y). 
Normalization  results  in  pan  from  the  negative  feedback  of  information  con¬ 
cerning  the  system  state  (Fig.  7.9)  and  in  pan  from  the  choice  of  adaptive 
algorithms  described  below  (Eqs.  73a,  73b,  and  73). 

tei^-kFfXjJFfn  (73a) 

where  FfY)  *  2  FT*fA*f  and  k  is  a  positive  constant. 

However,  this  is  still  not  enough  to  permit  successful  input  discrimination, 
which  depends  additionally  upon  introduction  of  a  reinforcing  input. 

Rein  forcing  Input 

Reinforcement,  or  identification  of  the  particular  input  Ffxtf  to  be  discrimi¬ 
nated  or  enhanced  by  increasing  a/,  is  done  by  introducing  a  separate,  label¬ 
ing  input  F(z )  with  az  fixed  and  negative  (Eq.  73b). 

*-kF(Xi)  [Zflxi)  a,-  +  Ffz)  a*]  (73b) 

Given  an  input  F(xj),  a ,■  will  increase  if  Ffz)  is  present  and  will  decrease 
if  Ffz)  is  absent.  With  repeated  reinforcement.  or  assumes  the  function  of  the 
acquisition  curve  shown  in  Fig.  7.7  (left)  with  Act/  *  -  ctf  (line  “ b "  of 
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Significance  of  Locus  of  Negative  Feedback  of  Information  Concerning  System  Slate 
Relative  to  Level  at  which  the  System  State  Becomes  a  Binary,  AIl-or-None  Output 


Syatem  A 


negative  feedback  t 


Region  of  binary 
.  transformation 


Syatem  B 


0  negative  feedback 

-  ■  -  |  Region  of  binary 

y  ^  transformation 

K _ 

"Not  OK” 


Adaptivel 

element 


Fig.  7.9 .  By  changing  the  locus  of  negative  feedback  so  that  instead  of  sampz 
ling  the  internal  state  of  the  adaptive  element,  as  in  (A),  one  samples  only  the 
binary  output  of  the  adaptive  element,  as  in  ( B ),  one  loses  information  re¬ 
quired  for  normalization  and  an  unsatisfactory  adaptive  process  may  ensue. 
The  location  of  the  binary  encoder  is  shown  by  Hi.  (Cf  Uttley  [1033] J 


Fig.  7.8).  Without  reinforcement,  crf-  assumes  the  function  of  the  extinction 
curve  in  Fig.  7.7  (left),  with  Act,-  =  a,*  (line  of  Fig.  7.8).  Without  a  rein- 
forcer,  F(z),  a  curve  such  as  that  shown  in  Fig.  1.1  (right)  would  be  obtained. 

The  transfer  properties  of  Uttley's  adaptive  element  are  designed  then  to 
simulate  the  S-shaped  acquisition  curve  of  conditioning  plus  its  decrement 
during  extinction.  Considerable  attention  is  also  paid  to  controlling  and  limit¬ 
ing  elemental  adaptation  by  closed  loop,  negative  feedback  of  the  element's 
internal  state.  This  variable  provides  a  significant  constraint  on  the  operation 
of  the  adaptive  element  and  may  constitute  a  general  requirement  of  success¬ 
ful  self-organizing  adaptive  operations. 

Mutual  Information  Constraint 

Uttley  imposes  one  further  constraint  on  the  operation  of  an  informon,  name¬ 
ly,  that  a  be  a  modification  of  Shannon's  mutual  information  function*: 


P(x{  md  Y) 
log  1  ■ -  ■— 


•nxf.Y) 
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This  constraint  can  be  applied  to  the  operation  specifled  in  Eq.  7.3b.  As  a 
result: 


a,-  +  ln/tfO  -  In/T^lO]  •  (7.4) 

or  to  simplify 

a^-KIQcjiY)  (7  JO 

Thus,  an  increase  in  Ffxj)  will  result  in  an  increase  in  a,*;  an  increase  in 
F(Y)  will  also  increase  a£*»  but  an  increase  in  F(x^)  F(Y)  will  decrease 

In  summary,  parallel  processing  systems  with  adaptive  elements  appear  to 
handle  discrimination  tasks  quite  easily.  Hierarchically  organized  networks, 
such  as  pandemonium,  with  non-uniform  elements  and  specialized  adaptive 
properties  can  handle  some  forms  of  learning  with  particular  ease,  but  may 
ding  tenadously  to  errors  in  discrimination  arising  from  their  particular  de¬ 
sign.  (This  erroneous  “behavior”  is  not  unlike  that  of  perseveration  and  neg¬ 
lect  described  in  Chapter  6.)  Other  automata,  such  as  the  informon,  may  rely 
on  optimized  properties  of  more  uniform  adaptive  elements.  As  Uttiey  has 

shown  [1036-1038],  the  adaptive  weightings  must  change  in  ways  that  are _ 

nonexplosive.  Introduction  of  negative  feedback  of  information  concerning 
the  state  of  the  controlled  system  can  contribute  to  a  normalization  process 
which,  in  turn,  can  reduce  the  possibility  of  explosive  change.  Other  features 
such  as  relaxation  of  increased  weighting  and  discriminative  control  of  the 
weighting  changes  of  certain  inputs  require  additional  features.  These  may 
indude  particularized  dependencies  between  inputs  such  as  the  mutual  infor¬ 
mation  feature  of  Uttley's  model  or  labeled  reinforcing  inputs  such  as  F(z)  of 
Uttley’s  model.* 

By  slightly  redefining  Uttley’s  circuits  (Fig.  7.10),  it  is  possible  to  form 
dosed  loop,  positive  feedback  pathways  that  might  support  motor  labeling  in 
dassical,  assodative  conditioning  (see  Chapter  3).  Positive  feedback  would 
augment  a  particular  message  of  motor  significance  transmitted  within  a  spe- 
dfic,  dosed  loop  circuit.  The  augmented  message  would  facilitate  the  forma¬ 
tion  of  adaptations  along  the  pathway.  Another  mechanism  (e.g.  inactivation) 
would  be  required  to  avoid  explosive  change. 

Further  support  for  a  possible  role  of  positive  feedback  in  neural  control 
systems  is  furnished  by  Freeman’s  model  of  olfactory  bulb  circuitry  [299] . 

In  that  model,  the  effect  of  the  stimulus  is  to  increase  feedback  gain  in  an  en¬ 
semble  of  neurons  that  are  receptive  to  the  stimulus.  “If  a  local  ensemble  con¬ 
taining  sensitized  subsets  that  are  mutually  excitatory  is  excited,  the  basis 
exists  for  a  regenerative  increase  in  activity  in  response  to  an  adequate  stimu¬ 
lus”  [299] .  The  model  has  five  main  features: 

•a  simplification;  properly,  the  equation  incorporates  the  ensemble  average  of  the  fr»> 

?uencies  of  signal  occurrence.  See  tittley  ( 1036] . 

Further  material  concerning  these  equations  can  be  found  on  pp.  381,382. 

*For  farther  particularizations  of  interest,  see  Uttlcy,  A.  M.  Information  Transmission  in 
the  Nervous  System.  London:  Academic  Press,  1979. 
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Feedback  of  Motor  Labeled  Information 


Fig,  7.1  0.  Schema  for  mo  tor  (M)  labeled  reinforcements  derived  from  Uttlev  *s 
informon  model  The  US  activates  neurons  which  act  directly  (or  indirectly) 
as  the  F(z)  input .  Selective  labeling  of  the  ~ upstream  ”  neurons  which  project, 
selectively,  to  the  activated  units  is  potentiated  because  of  positive  feedback 
within  the  circuitry .  For  this  schema  to  operate  successfully,  some  feature 
such  as  local  recurrent  inhibition  would  be  required  to  monitor  the  system 
state  and  prevent  explosive  buildup  from  the  positive  feedback .  IS  feedback 
of  information  concerning  internal  system  state . 


1.  A  nonlinear  signal  range  that  is  near  linear  about  the  origin. 

2.  Bilateral  saturation  with  gain  approaching  zero  at  both  extremes  of  wave 
amplitude  (this  feature  provides  stability).  * 

3.  A  2:1  asymmetry  of  the  asymptotes  of  the  circuit  transfer  function 
(arising  from  the  features  of  the  olfactory  bulb  and  cortical  eiectrophysi- 
oiogy  on  which  the  system  is  modeled). 

4.  A  gain  that  increases  with  positive  (excitatory)  input. 

5.  A  gain  that  is  modifiable  in  a  pattern  that  depends  on  background  or  steady 
state  activity,  which  in  turn  is  presumed  to  be  under  centrifugal  control. 

The  positive  feedback  should  satisfy  three  constraints  for  stability:  (l)  the 
regenerative  effect  should  not  be  unduly  perturbed  by  noise.  (2)  it  should  be 
seif-limiting  in  maximal  amplitude,  and  (3)  it  should  be  rapidly  self-terminating 
to  permit  additional  inputs  to  pass  [299]. 


Analysis 

Analysis  of  the  organization  of  systems  as  complex  as  the  brain  need  not  be 
considered  impossible  when  systems  involving  complex  communication  (tele¬ 
vision),  learning  (computer  automata),  elaborate  control  mechanisms  (guided 
missiles),  and  even  uncertainty  (the  atom)  have  proved  amenable  to  analysis. 
It  is  possible,  in  principle,  to  analyze  a  complex  system  if  it  is  finite,  obeys 
the  laws  of  physics,  and  meets  the  constraints  of  the  analytic  method.*  This 


•One  should  never  underestimate  the  importance  of  this  Utter  consideration  (see  pp. 
322-401  and  Epilogue). 
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is  so  irrespective  of  whether  the  system  is  biological  or  mechanical.  Means  ex¬ 
ist,  such  as  linear  systems  analysis  (p.  366),  for  partitioning  many  complex 
systems  into  relevant  suboperations  that  are  easier  to  analyze,  and  some 
neural  systems  are  amenable  to  this  form  of  partitioning  [429,1103,1123]. 
Other  means  such  as  flow  graph  techniques  (p.  368)  can  be  used  to  analyze 
neural  network  operations  on  a  cell  to  cell  basis  despite  complex  interrela¬ 
tionships  including  feedback  between  receptor  and  effector  functions.  Finally, 
means  can  be  found,  as  by  computer  simulations,  to  reassemble  and  test  the 
analyzed  component  functions  with  reference  to  the  overall  organization  of 
the  network. 

Apart  from  complexity,  another  objection  that  is  frequently  raised  to 
analyzing  brain  function  is  that  general  physical  theories  comparable  to  those 
found  in  chemistry  or  other  basic  disciplines  are  lacking.  While  it  is  true  that 
theories  of  information  handling  are  not  so  advanced  as  those  in  other  fields, 
the  existing  theories  have  been  found  applicable  to  predictive  treatment  of 
information  handling  by  real  systems.  The  usefulness  of  Shannon’s  infor¬ 
mation  coding  theories  in  the  communications  industry  is  well  established 
and  has  been  complemented  by  the  emergence  of  additional  theories  in  the 
areas  of  systems  control.  The  challenge  for  neuroscientists  is  to  develop 
extensions  of  the  above  theories  that  are  applicable  to  treatment  of  specific 
neural  information  processing  systems.  The  basic  purpose  of  the  material  that 
follows  is  less  ambitious,  being  simply  to  outline  some  of  the  potentially  rele¬ 
vant  analytic  methodologies. 

Signal  Analysis 

The  fundamental  idea  of  Wiener  and  Lee’s  approach  to  analysis  of  communi¬ 
cations  systems  is  that  messages,  signals,  and  noise  should  be  considered  sta¬ 
tistically  and  described  in  terms  of  probability  theory  [532],  Messages  are 
information  carrying  functipns,  i.e.  member  functions  in  an  ensemble,  or 
numerically  large  aggregate,  of  signals  (relevant  information)  and  noise  (irrele¬ 
vant  information)  and  their’eombinarion.  Communication  theory  has  led  to 
analysis  of  linear  message-transmission  systems  using  convolution  as  the  basic 
analytic  device.  Given  a  linear  system  (p.  396)  and  consideration  of  signals  and 
noise  as  random  processes  [582],  signal  analysis  can  be  performed  by  time 
series  analysis  utilizing  (I)  Fourier  series,  (2)  power  spectral  density,  (3)  cor¬ 
relation,  and  (4)  convolution  (Table  7 2). 

Most  signals  to  be  analyzed  within  the  CNS  are  changes  in  voltage  or  cur¬ 
rent  as  a  function  of  time .  To  determine  the  structure  of  a  signal,  it  is  analyzed 
in  terms  of  its  frequency  components  (c.f.  Figs.  530,  7.11,  7.12,  and  7.14). 
The  signal  may  be  described  in  terms  of  its  major  frequency  components 
(Figs.  7.1 1,  7.12)  or,  more  precisely,  in  terms  of  the  power  consumed  across  a 
1  ohm  resistor  by  passage  of  the  different  frequency  components  of  the  signal 
(including  harmonics).  The  latter  iscallcd  the  power  spectral  density  (Fig.  7.14). 
Some  information,  that  concerning  the  phase  of  one  frequency  component 
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Control  of  Adaptive  Systems 

Linear  systems  analysis  admits  a  general  theory  of  adaptive  control  provided 
that  the  system  is  linear  and  the  usual  constraints  are  satisfied.  One  constraint 
is  that  the  resuit  of  adaptation  depend  on  the  entire  past  history  of  adapta¬ 
tion  within  the  system.  Another  is  (usually)  that  the  transfer  function  of  the 
system  be  time  invariant. 

When  using  this  theory,  adaptation  is  introduced  as  a  controller  function, 
g(t),  as  in  Fig.  7.24.  It  operates  by  adding  an  additional  input  to  the  system 
much  like  F(Y),  the  negative  feedback  of  the  system  state,  in  Urtley’s  infor- 
mon.  It  does  not  directly  modify  the  original  system  transfer  function.  H(t). 
To  do  the  latter  would  lead  to  a  time-variant  or  self-organizing  adaptive 
system  which  could  easily  be  nonlinear  and,  therefore,  no:  amenable  to 
analysis  by  this  theory. 

For  a  linear  system  with  the  feedback  circuit  shown  in  Fig.  7.24(A),  the 
output,  YftJ  is  a  function  of  the  input,  X(tj%  the  system  transfer  function,  H(t) 
and  the  controller  function,  g( t).  If  the  LaPUce  transform,  F(s),  of  each  func¬ 
tion  is  taken, 

e.g..  Output  F(y)  *  X  Y(t)  =  j  Y(tje£tdt,  (7.49) 

(note  relationship  to  Fourier  transform,  Eq.  7.6),  then,  for  a  linear  system, 

where  /i  *  /a  *  Fx  ( s)  (s)>  '  (7.50) 

Le„  in  the  absence  of  a  control  loop, 

F(y)  *  F(x)  Ffh).  (7.5!) 

The  output  of  the  linear  system  with  negative  feedback  (Fig.  7X24 A)  may 
therefore  be  expressed  as 

fM-sn  g?;.. 

l  +  F(h)F(g) 

For  the  feedforward  circuit  shown  in  Fig.  7.24(B), 

F(y)*  1 +F(g)  F(x)F(h) 

assuming  posirive  feedforward. 

One  may  wish  to  consider  the  linear  control  circuits  of  Fig.  7.24.  the 
designs  of  automata  shown  in  Fig.  7.5,  and  the  algorithms  of  adaptation  listed 
on  p.  395  in  reiation  to  the  descriptions  of  control  systems  that  follow. 


(7-52) 


(7-53) 
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Control  Systems 

Several  types  of  control  systems  are  recognized,  each  with  its  own  critical 
feature(s).  For  example,  there  are: 

Control  systems: 

1 .  With  or  without  memory. 

2.  With  or  without  set  point  variance. 

3.  With  or  without  self-organizing  adaptation. 

4.  With  open  or  closed  loop  control. 

5.  With  feedforward  or  feedback  control- 

The  list  is  by  no  means  complete  or  (in  considering  how  to  classify  different 
types  of  switches,  flywheel  governors,  thermostats,  and  innate  or  learned  be¬ 
haviors)  are  all  of  the  differences  unique  or  mutually  exclusive. 

Adaptations  involved  in  control  may  reach  some  maximum  or  minimum 
value,  or  may  proceed  at  some  steady  state  level  with  or  without  range 
bounding  as  was  described  earlier  (Figs.  7.7,  7.8). 

Open  Loop  Adaptive  Control  Systems 

An  open  loop  control  system  receives  no  feedback  information  regarding  the 
state  of  the  adaptive  system.  There  may  be  indirect  feedback  of  information 
(e.g.,  from  the  environment  and  changes  therein  caused  by  the  system’s 
operation)  to  support  the  predetermined  system  operation,  but  not  to  cause 
the  controller  to  adapt.  Control  is  exercised  entirely  by  predetermined 
adaptations  based  on  the  detection  of  predefined  contingencies.  Thus,  in  a 
thermostat  adaptation  occurs  on  the  basis  of  temperature  detection  plus  a 
prespecified  contingency  (if  the  temperature  is  low,  turn  on  the  heat;  if  high, 
turn  it  off).  There  is  no  feedback  to  alter  the  rules  of  adaptation  based  on 
past  performance.  There  is  instead  an  input  of  ambient  temperature  and  a 
fixed  course  of  adaptation  contingent  on  its  level.  Neuronally,  open  loop 
adaptation  may  be  contingent  on  two  different  synaptic  inputs  occurring 
together,  as  with  heterosynaptic  facilitation  and  inhibition. 

Open  loop  control  systems  will  typically  have  great  stability  since  their 
adaptive  features  are  entirely  predetermined.  However,  it  may  be  difficult  to 
achieve  a  control  operation  of  high  sensitivity  with  an  open  loop  system.  This 
is  because  the  accuracy  of  control  depends  on  the  system’s  initial  calibration 
and  on  the  precision  of  the  involved  components.  The  operation  of  open  loop 
control  systems  will  be  vulnerable  to  component  breakdown  or  interference 
from  outside  noise  that  was  unanticipated  in  their  original  control  design. 
Driftage  away  from  the  initial  component  set  point  is  uncorrectable  with  an 
open  loop  control  system.  There  is  also  no  possibility  for  self-organuing  adap¬ 
tation,  since  there  is  no  regard  for  the  present  or  past  system  state. 

Closed  Loop,  Feedback  Control  Systems 

A  closed  loop  control  system  normally  uses  feedback  concerning  the  value  of 
a  controlled  variable  or  the  state  of  the  adaptive  control  system,  as  a  means  to 
control  further  adaptation.  In  a  dosed  loop,  self-organizing  control  system, 
the  response  of  the  modified  element  should  have  a  direct  effect  on  the 
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control  action  (Fig.  7.24A).  This  circuitmay  be  compared  with  that  of  a  feed¬ 
forward  control  system  (Fig.  7.24B)  in  which  information  from  the  input 
modifies  the  controller  without  regard  to  the  system  state* 

Either  feedback  or  feedforward  circuitry  can  be  used  to  reduce  the  error 
or  improve  the  response  time  of  linear  control  operations,  such  as  described 
earlier,  and  the  circuitries  may  be  either  positive  or  negative.  Because  of  the 
dosed  loop  operation,  feedback  may  have  ;elf-potentiating  effects  when  it 
operates  either  as  a  supplemental  control  input  to  the  system  or  as  a  seif- 
organizing  modifier  of  the  system's  original  transfer  function.  Positive  (re¬ 
generative)  feedback  is  distinguished  from  negative  (degenerative)  feedback  in 
that  the  former  augments  the  gain  of  the  loop  system  and  can  lead  to  explo¬ 
sive  buildup.  Positive  feedback  returns  an  output  to  the  input  so  as  to  add 
another,  positive  input.  This  will  permit  rapid  change  or  increased  sensitivity 
of  the  system  by  which  transforms  between  input  and  output  are  performed; 
however,  it  also  tends  to  unstabilize  the  system  and  increase  distortion  of  the 
signal  input.  Xegative  feedback  returns  the  output  to  the  input  in  such  a  way 
as  to  add  another,  negative  input.  Negative  feedback  then  decreases  the  g  \>a 
of  the  loop  system  and  can  lead  to  damping  or  a  cut  off  of  signal  transmission. 
This  tends  to  stabilize  the  transfer  between  input  and  output  and  reduce  distor¬ 
tion,  although  the  sensitivity  and  rapidity  of  the  transfer  operation  may  be 
reduced. 

Negative  feedback  control  systems  have  a  system  response  that  is  relatively 
insensitive  to  brief  external  disturbances  and  to  internal  variations  in  para¬ 
meters  of  the  operations  controlled.  This  is  because  the  output,  t.z.,F(y)  in 
Eq.  7.52,  approaches  F(xj  -r  F(gj  if  F(h)  FfgJ  >  i.  Thus,  small  deviations  in 
component  operations  or  even  the  original  control  parameters  may  not  overly 
disturb  the  control  system,  provided  that  their  manifestations  axe  accessible 
to  the  control  loop.  This  permits  relatively  noisy  components  to  be  used  for 
the  system  operation.  Note,  however,  that  when  a  dosed  loop  system  is 


(A)  Feedback 


(B)  Feed  forward 


HO/  HO / 


10/  g  (0 


Fig*  7.24.  Linear  systems  with  feedback  control  (A )  and  feedforward  control 
{ B) .  The  systems  have  input  X(t /,  transfer  function  H(tj  and  output  Yft). 
gft/  and  gft)  are  the  controller  functions.  Differences  between  applying  the 
output  of  the  controller  function  as  an  “extra'*  (additive)  system  input  versus 
applying  it  to  direct  adaptation  of  the  system  transfer  function  are  discussed 
in  the  text. 
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carrying  a  range  of  frequencies  over  the  feedback  path,  the  frequency  charac¬ 
teristics  of  the  network  may  become  an  important  source  of  error.  At  one  fre¬ 
quency  the  phase  of  the  signal  fed  back  may  be  such  as  to  produce  negative 
feedback,  but  at  another  frequency  the  phase  relationships  maybe  such  as  to 
cause  positive  feedback,  and  oscillations  may  occur.  Stability  of  control  can 
therefore  be  a  problem  with  dosed  loop  control  operations,  since  with  dosed 
loop  adaptive  control,  there  may  be  oscillating  errors  of  overcorrection  leading 
to  explosive  instability  or  drift  in  an  undesired  direction.  The  latter  feature, 
taken  in  a  converse  manner,  lends  itself  to  self-organizing  adaptive  control, 
provided  that  some  means  be  found  to  avoid  maladaptation. 

Some  typical  characteristics  of  dosed  loop  systems  which  may  be  of  inter¬ 
est  with  regard  to  their  possible  use  m  the  design  of  self-organizing  systems 
are  as  follows: 

1.  Some  sUblc  dosed  loop  systems  tend  to  have  a  transient  response  per¬ 
formance  which  can  be  predicted  from  the  steady-state,  dosed  loop  plot 
of  magnitude  versus  frequency  (e.g.,  Nyquist  plot). 

2.  A  system  designed  for  optimal  steady-state  operation  may  have  unstable 
transient  characteristics. 

3.  Self-organizing  adaptive  systems,  Le.,  control  systems  that  incorporate 
time-variance  based  on  system  operation  into  the  adaptive  scheme,  must 
have  some  means  of  evaluating  how  well  the  control  operations  are  being 
performed.  This  index  of  performance  must  be  reliable  and  unambiguous 
with  respect  to  the  optimal  range  of  operation. 

4.  It  should  be  possible  to  obtain  a  performance  index  without  disturbing 
the  operation  of  the  system  and  in  a  form  which  is  amenable  to  insertion 
into  that  part  of  the  system  in  winch  control  of  adaptation  is  accomplished. 

5.  If  hill-climbing  techniques  are  used  to  control  steady -state  adaptation 
[e.g.,  883] ,  false  peaks  must  be  defined  and  avoided. 


Other  Mathematical  Techniques 

The  two  theories  that  follow  are  introduced  because  of  their  promise  tor 
advancing  our  ability  to  analyze  complex  adaptive  networks.  Their  mention 
is  abbreviated  because  of  their  novelty  and  because  so  little  is  known  at 
present  about  their  proper  application. 

Ergodic  Theory 

Ergodic  theory  “is  concerned  with  the  average  behavior  of  large  collections  of 
molecules  that  move  randomly  for  indefinite  periods  of  time  . . .  Ergodic  the¬ 
orists  commonly  deal  with  measure  and  probability  spaces  and  have  developed 
powerful  theorems  involving  ramification  of  these  ideas  [537] .“  The  reader  is 
referred  to  Kolata  [537]  for  further  discussion  of  ergodic  theory. 


Field  Theory 

“Field  theory,  as  elaborated  by  Weiss,  Wolpert,  and  others"  indicates  that  a 
field  “can  be  defined  operationally  as  a  domain  within  which  changes  in  the 
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presumptive  fates  of  ceils  can  occur”  [300] .  Cells  may  be  assigned  positional 
values  according  to  their  physical  locations  in  the  coordinate  system  of  a  par¬ 
ticular  field.  In  terms  of  positional  information  theory,  the  field  can  be  de¬ 
fined  as  a  set  of  cells  which  have  their  positions  specified  with  respect  to  the 
same  coordinate  system.  Further  information  is  available  elsewhere  [300]. 

Specific  Theories  of  Line  Labeled  Information  Handling 

A  Geometry  of  Perception^Processing  of  Sensory  Labeled  Information 

Minsky  and  Papert  [672]  have  uncovered  the  beginnings  of  a  powerful 
mathematical  theory  concerning  a  geometry  of  perception  pertaining  to  the 
processing  of  sensory  labeled  information.  The  theory  also  deals  with  adap¬ 
tive  features  of  the  processing.  The  topologic  transformation  of  problems  of 
image  recognition  and  perception  into  problems  of  line  labeled  geometry  is 
insightful  and  potentially  more  useful  than  these  authors  may  have  imagined 
originally. 

As  shown  in  Fig.  7.25,  image  processing  involves  sets  of  receptive  elements 
that  receive  and  process  aggregates  of  sensory  labeled  information.  Each 
unique,  sensory  labeled  set  independently  processes  its  sensory  aggregate  ac¬ 
cording  to  some  function,  The  results  of  processing  by  each  set  are  com¬ 
bined  by  means  of  a  function  ft  to  obtain  the  value,  The  problems  to  be 
resolved  are; 

1.  How  can  arrays  of  this  sort  be  organized  to  permit  a  particular  to  be 
a  useful  designator  of  a  particular  input,  X>  at  the  receptor  elements? 

2.  Can  a  geometry  be  devised  that  will  describe  this  process  precisely  and  de¬ 
fine  some  reasonably  optimal  approach  to  this  problem! 

Minsky  and  Papert  begin  their  solution  of  these  problemsbv  pointingout 
that  some  meaningful  restrictions  must  be  placed  on  the  function  12  and  the 
set  $  of  functions  ^^2,...,  if  the  geometry  is  to  be  useful.  And  they 
point  out  that  previous  treatments  of  this  type  have  been  more  anecdotal 
than  mathematical. 

It  is  also  desirable  to  introduce  variable  weighting  or  some  other  potential 
means  of  adaptation,  into  the  analysis.  As  shown  in  Fig.  7.26,  weightings  , 

.  •  •  •*«/!  may  be  assigned  each  function  s?i  *7 v 

In  addition,  12  may  be  replaced  by  a  summation  or  integration  function, 
£,  and  a  threshold  detector,  0,  may  be  added  to  designate  a  particular  value 
or  region  of  When  a  is  variable,  this  constitutesa  simple  perceptron.  named 
after  the  automata  of  this  general  type  that  were  designed  by  Rosenblatt 
[838*841] .  It  is  noted  by  Minsky  and  Papert  that  in  such  automata  o  tends 
to  grow  faster  than  12  in  adaptive  processing  operations  requiring  memory 
stonge. 

The  more  complex  perceptron  admits  multiple,  redundant  inputs  as  shown 
in  Fig.  727.  This  type  of  processing  of  sensory  labeled  information  corre¬ 
sponds  closely  to  that  carried  out  by  the  nervous  system  and  is  amenable  to 
analysis  by  means  of  the  Group  Invariance  Theorem. 
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A  Simple  Inuge-Proccssing  Automaton 


Fig.  7.25.  An  example  of  simple,  multiple  channel,  image  processing.  See 
text  for  further  details  (From  Minsky  and  Papert  [6  72].) 


Croup  Invariance  Theorem 

The  Group  Invariance  Theorem  of  Minsky  and  Papert  permits  analysis  of 
perceptron  operations  (i.e.,  the  geometry  of  sensory  image  processing)  by 
algebra  instead  of  statistics.  This  theorem  examines  the  relationship  between 
all  possible  receptor  activations  (all  sets  of  sensory  labels,  rx ,  r2 , . . rn)  and 
thei;  representation  across  a  theoretical  space  of  a^p(X)  for 

A  Perceptron 


Fig.  7.26.  Elementary  perceptron  (a  can  be  varied }.  ( From  Minsky  and  Pap* 
ert  [672].) 
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Equivalence  Between  Parallel  Processing  and  Group  Invariance  Theorem 


Fig.  7.27.  A  pcrceptron  reduced  to  Group  Invariance  Theorem  coefficients. 
(From  Minsky  and  Papert  [672}.) 

In  effect,  the  Group  Invariance  Theorem  permits  an  algebraic  analysis  of 
all  geometries  of  rearrangements  (or  representatiom)  of  the  original  set  of  pos¬ 
sible  receptor  labeled  activations.  It  allows  determination  of  which  aggregates 
of  (or  values  of  4 t)  reflect  a  unique  transformation  of  the  group  of 

possible  transformations  of  the  space  of  the  receptor  labelings,  rx ,  r2 , . .  rn, 
upon  the  predicates,  < it ,  Vn- 

Ghren  any  predicate  and  group  element  g,*  Minsky  and  Papert  define 
spg  to  be  the  predicate  that,  for  each  X ,  has  the  value  c{X).  Thus,  one.will 
always  have  \?g{X)  *  >p(gX).  will  be  said  to  be  closed  under  G  if  for  every 
«p  in  $  and  g  in  G  the  predicate  £?  is  also  in  4>.  If  a  perception  predicate  is 
invariant  under  a  group,  G,  then  its  coefficients  need  depend  only  on  the 
(/-equivalence  classes  of  their  <p’s  [672]. 

The  Group  Invariance  Theorem  states  that  if: 

(i)  <7  is  a  finite  group  of  transformations  of  a  finite  space,  R\ 

•Given  a  group  G.  two  figures,  M  and  S,  are  equivalent  if  there  U  a  member  r  of  C 
for  which  M •gS. 
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(ii)  is  a  set  of  predicates  on  that  space  closed  under  G ; 

(iii)  ^  is  in  L  (<f>)  and  invariant  under  G.  Then,  there  exists  a  linear  repre¬ 
sentation  of 


for  which  the  coefficients  2^  depend  only  on  the  (7-equivalence  class  of 
*p,  that  is  if  p  g  p  then  s  py. 

L  $  is  the  set  of  all  predicates  for  which  &  is  a  linear  threshold  function 
with  respect  to  d>,  and  a  predicate  is  a  function  that  has  two  possible  values, 
i.e.,  a  binary  function.  y  is  a  linear  threshold  function  with  respect  to  <t\ 
(dp  is  in  L  (4>),  if  there  exists  a  number  (?,  and  a  set  of  numbers,  or  one  for 
each  \p  in  <fr,  such  that: 

.  (7J4) 

Restrictions  on  Perception  Operations  and  Limitations  in  Geometric  Patterns 
That  Can  Be  Recognized 

Perccptron $  are  not  without  restrictions  in  the  types  of  operations  that  can  be 
performed  and  the  geometric  patterns  that  can  be  recognized. 

Restrictions  of  Geometry.  The  perccptron  operations  discussed  by  Minsky 
andPapert  have  a  receptor  geometry  restricted  as  follows: 

1 .  The  number  of  points  (or  receptive  elements)  is  limited.  Hence,  the 
predicates  of  the  points  are  of  limited  order. 

2.  The  distances  between  points  are  restricted.  Hence,  their  predicates  are 
diameter-limited. 

Order  has  to  do  with  the  number  of  characteristic  variables  needed  to 
represent  a  set  of  particular  functions.  For  example,  the  order  of  if  is  the 
smallest  number,  Kt  for  which  a  set  <f>  of  predicates  can  be  found  satisfying: 

(S(l)|  <  K  for  all  p  in  d>,  ^c£(<S>) 

where  S(p)  is  that  subset  of  receptors,  rx ,  rit  . . rfll  upon  which  y{i(X) 
(the  set  of  functions  required  for  recognizing  X)  really  depends,  and 
£(<&)  is  the  linear  threshold  function  of  <t>,  the  set  of  all  predicates  that  can 
be  defined  by  Eq.  7.54. 

Linear  threshold  function  perception  operations  are  of  order  1.  So  are  all 
the  Boolean  functions  of  two  variables  except  for: 

L  Exclusive-or  (XY4  +  X'Y  >  0)  and 

ii.  Its  complement  identity ,  X *  Y  (XY  +  X*  Y'  >  0) 


which  are  of  order  2. 
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Type  of  Processing  Operations.  Percepttons  are  particularly  good  at  doing 
processing  operations  of  the  types  called  “local”  or  “conjunctively  local”  by 
Minsky  and  Papert  [672] .  By  local  is  meant  that  all  tests  (analytic  or  logical) 
can  be  done  independently  and  the  final  decision  can  be  made  by  a  logically 
simple  procedure  such  as  unanimity  of  all  tests. 

A  predicate,  &  is  conjunctively  local  of  order  K  if  it  can  be  computed 
by  a  set  $  of  predicates  such  that: 

L  Each  ?  depends  on  no  more  than  K  points  of  the  space  R ; 
ii.  it{X)  *  ( 1  if  \p(X)  *  1  for  every  <p  in  $ 

(0  otherwise. 

Such  processing  will  enable  a  perception  to  distinguish  convex  from  non- 
convex  figures  at  the  receptors  by  the  test  that  if  there  exist  three  receptor 
points,  p,  qt  and  r,  such  that  q  is  in  the  line  segment  joining  p  and  r,  and 

p  is  in  X, 
q  is  not  in  X% 
r  is  in  X.  t 

then  the  set  X  is  not  convex  (Fig.  7.2S).  Thus.  ^Conve\W  is  conjunctively 
local  of  order  3  by  application  of  this  three-poi^!,  rule  [672] . 

Interestingly,  the  determination  of  connectedness  between  points  can  be 
shown  not  to  be  conjunctively  local  of  any  order  in  a  diameter-limited  per- 
ceptron  processing  operation.  Hence,  perceptions  of  this  type  cannot  com¬ 
pute  connectedness  of  geometric  figures  whereas  they  can  compute  convexity. 
However,  as  inspection  of  Fig.  6.6C  will  indicate,  we,  too,  have  our  difficulties 
in  determining  connectedness. 

Types  of  Perceptions 

Given  that  “a  Perceptron  is  a  device  capable  of  computing  all  predicates  - 
which  are  linear  in  some  given  set  $  of  partial  predicates”  [672] ,  five  dif¬ 
ferent  types  of  percep trons  can  be  distinguished.  They  are: 

1.  Diameter-limited  Perceptions— the  set  of  points  upon  which  each  c 
depends  (for  each  in  some  given  set  <&)  is  restricted  not  to  exceed  a  certain 
fixed  diameter  in  the  plane. 

2.  Order-restricted  Perce  ptro  ns— sl  perceptron  has  order  <  n  if  no  mem¬ 
ber  of  $  depends  on  more  than  n  points. 

3.  Cam  ba  Perceptrons—e ach  member  of  <P  may  depend  on  ail  the  points 
but  must  be  a  linear  threshold  function,  with  each  member  of  <fc  itself 
being  computed  by  a  perceptron  of  order  l.  Thus, 


i 

(each  <f  i  is  a  threshold  perceptron  of  order  1 )  and 
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Not  Convex  Convex 


(Li- Ting  circa  1300  B.CJ  (Ting  circa  400  B.C.) 


Fig.  7.28.  Determination  of  convexity  by  three-point  rule  [672].  Draw  a 
straight  line  connecting  surface  points  such  as  P  and  R  If  a  third  point \  taken 
anywhere  along  this  line ,  is  inside  the  space  of  the  object,  the  surface  is 
convex . 


c7-55) 

i  i 

The  Gamba  perceptron  is  thus  a  two-layered  perceptron.  Note,  however, 
that  no  improvement  is  afforded  by  any  multi-layered  system,  without 
loops,  in  which  there  is  an  order  restriction  at  each  layer  wherein  only 
predicates  of  finite  order  are  computed. 

4.  Random  Pcrceptrons- the  <p’s  are  random  Boolean  functions.  They 
are  order-restricted  and  $  is  generated  by  a  stochastic  process  according 
to  an  assigned  distribution  function  (cf.  Rosenblatt  [838-841]). 

5.  Bounded  Perception* contains  an  infinite  number  of  ^’s,  but  all 
the  lie  in  a  finite  set  of  numbers  1672). 

Size,  Speed,  and  Layer-Hierarchy  Considerations  in  Perceptron  Operations 
Given  application  of  the  group  invariance  theorem  to  analysis  of  per ceptrons 
of  the  above  types,  several  observations  may  be  drawn  concerning  effects  of 
size,  speed,  and  layer  or  hierarchy  of  operation. 

Pint,  using  more  ~  memory”  does  not  seem  to  advance  the  kinds  or  effici¬ 
encies  of  linear  threshold  operations  that  are  performed.  This  is  interesting 
because  many  believe  that  adding  memory  will  greatly  improve  the  types  of 
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operations  that  can  be  performed.  Minsky  and  Papert  would  suggest  that 
design  is  more  important  than  size.* 

Second,  it  should  be  possible  to  specify  connection-matrices  between  ele¬ 
ments  that  will  optimize  the  efficiency  of  processing  vis-a-vis  the  number  of 
elements  involved.  Examples  of  different  connection  matrices  are  shown  in 
Fig.  7.29. 

Multilayer  Perceptrons  with  Loops 

According  to  Minsky  and  Papert,  the  group  invariance  theorem  cannot  be 
applied  to  multilayered  perceptrons  with  loops,  t  The  addition  of  loops  thus 
reopens  analytic  questions.  It  remains  to  be  seen  how  the  addition  of  loops 
limits  general  theories  of  sensory  information  processing  by  perceptron-like 
automata.*  Some  analytic  questions  can  be  answered  a  priori.  For  example, 
the  use  of  loops  in  processing  will  not  improve  the  speed  of  computation 
afforded  by  loop-free  serial  processing.  Other  questions  cannot.  Thus,  it  is 
unclear  whether  or  not  loops  afford  the  possibility  of  more  complex  analytic 
operations.  Given  finite  order  processing,  a  prerequisite  for  mathematical 
analysis,  it  is  questionable  whether  loops  afford  any  order-improvement 
beyond  that  possible  with  a  hierarchical  multilayered  construction. 

What  loops  do  offer  is  the  possibility  of  using  the  simple  feedback  princi¬ 
ple  for  “training”  or  error  correction.  Minsky  ana  r'apert  believe  that  the  per- 
ceptron  convergence  theorem  provides  analytic  proof  that  where  such  “learn¬ 
ing,  adaptation  or  self  organization  does  occur,  its  occurrence  can  be  thorough¬ 
ly  elucidated  (mathematically )**  [672] . 

A  Geometry  of  Sorting- Treatment  of  Motor  Labeled  Effectuation,  Synthesis, 
and  Decision  Making 

Comparison  of  Fig.  730  with  Fig.  3.42  will  disclose  how  motor-labeled  ef¬ 
fectuation  or  decision  making  is  implicit  in  the  design  of  perceptions. 

What  has  not  been  treated  explicitly  in  the  course  of  analysis  of  perce p- 
tron  operations  is  the  geometry  of  sorting,  i.e.,  an  algebraic  analysis  of  motor 
labeled  effectuation  comparable  to  that  forsensory  reception  presented  earlier. 
Three  positions  are  possible.  One  is  that  this  geometry  is  completely  implicit 
in  the  classification  algorithms  described  by  Minsky'  and  Papert  (perhaps  as  a 
substructure  of  predicates).  The  second  is  that  significant  extensions  of  their 
algorithms  and  theory  need  to  be  made— perhaps  by  an  expanded  treatment  of 
conditional  probabilities  and  Markov  processes.^  The  third  position,  that  such 

*!t  is  not  yet  dear  if  artificial  intelligence  performed  by  a  Urge,  specifically  designed 
computer  (capable  of  "lopcaT*  operation)  can  adequately  simulate  intelligence  based  on 
unincorporated  design  features.  Logic  may  be  used  to  approximate  the  needed  features, 
but  the  results  may  be  unsatisfactory  and  the  siors  difficult  to  detect,  as  in  some  of  the 
phenomena  illustrated  in  Chapter  6. 

i  Although  it  will;  be  recalled  that  dosed  fiowgaphs,  consisting  of  loop  circuits,  can  be 
solved. 

JAlso,  some  loops  can  be  eliminated  by  use  of  ftowgrapha. 

^Another  cUss  of  algorithm  that  can  compute  connectedness  may  be  required-Turing 
machines  can  compute  connectedness;  perceptrons  cannot. 


_ 


A 
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Connection-Matrices 


Fig.  7.29.  Different  connection  matrices.  Are  those  in  (A)  equivalent  to 
those  darkened  i/s  (B)?  (There  is  feedback  in  A.)  Are  some  elements  and  con * 
necrions  in  B  superfluous ?  ( Even  if  different  transfer  functions  of  several  ele¬ 
ments  could  be  combined,  the  connections  would  allow  unique  dependencies 
between  inputs,  elements ,  and  outputs j.  (Sketches  after  Minsky  and  Papert 


A  Learning  Machine 


Fig.  7.30.  A  multilayer  perceptron  capable  of  making  decisions  (d).  (From 
Minsky  and  Papert  {672}.)  The  adaptations  controlling  A  wy  and  A  Cf^  might 
benefit  from  feedback  of  information  concerning  the  system  state. 
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a  geometry  and  analysis  is  unrealizable,  may  be  dismissed  if  one  accepts 
Minsky  and  Papert's  view  that  workable  systems  are  subject  to  analysis  and 
this  author's  assertion  that  such  systems  are  visible  within  the  reflex  pathways 
of  the  nervous  system. 

Classification  Algorithms 

The  following  classification  algorithms  for  separating  different  sensory  labeled 
aggregates  at  d  in  Fig.  730  have  been  suggested  by  Minsky  and  Papert  (672]. 

1 .  Perceptron  convergence  theorem.  Let  F  be  a  set  of  unit-length 
vectors.  Let  A  *  be  the  vector  notation  of  2  a  \p(X)>  If  there  exists  a 
unit  vector  A  *  and  a  number  5  >  0  such  that  A  4>  >  6  for  all  in  F, 
then  a  simple  program  (see  Minsky  and  Papert  (672],  p.  167)  can  be  de¬ 
vised  that  will  converge  in  a  finite  number  of  iterations  on  a  separation  of 
all  e  F.  A  variation  of  this  program  (see  [672])  will  separate  more  than 
two  classes  of  input  figures:  Fx  ,  F** ,  I*.,  Fn. 

A  limitation  of  this  classification  algorithm  is  that  only  linear  sepa¬ 
rations  are  performed  optimally  by  this  method. 

2.  Bayes*  linear  statistical  procedure.  Again,  let  F  be  a  set  of  unit- 

length  vectors,  with  one  vector,  Af  such  that  Aj  •  >  5  for  all  in  F.  If 


where  cj. 


V 


'LoiCr^r) 

1  pu 


and  P  is  the  probability  that  ^-*1 ,  given  that  $  is  in  Fy,  then  <f>  €  F  will  be 
separated  with  the  lowest  possible  error  rate,  given  that  the  <,p’s  are  statisti¬ 
cally  independent.  (This  is,  remarkably,  a  linear  formula  that  can  perform 
non-linear  separation.) 

3.  Best  planes  procedure— This  is  essentially  an  error-minimizing  track¬ 
ing  procedure  whereby  the  set  of  ^4’s  is  used  for  which  choice  of  the 
largest  A  -  •  <P  gives  the  fewest  errors.  The  presence  of  false  peaks  in  hUl- 
dimbing  searches  by  this  method  may  limit  its  applicability. 

4.  Cluster  analysis -Techniques  are  used  to  minimize  the  least  square 
distance  between  different  points  in  the  receptor  a  nay  (R)  reflected  by 
the  different  Ai  *  <&.  In  effect,  separation  is  performed  on  the  basis  of 
spatial  clustering  of  each  sensory  aggregate.  A  more  complete  description 
of  this  approach  and  a  duster-analysis  convergence  theorem,  with  proof, 
can  be  found  in  Minsky  and  Papert's  book  [672] . 

5.  Exact  matching  or  best  matching— This  approach  requires  a  large 
memory  and  is  cumbersome.  Each  that  has  ever  been  encountered, 
together  with  the  identity  of  its  associated  F-class,  is  stored.  New  inputs 
an  “recognized”  on  the  basis  of  match  against  the  store  contents.  With 
exact  matching,  a  tedious  search  results  in  a  solution  with  no  errots.  With 


"denotes  unit  vector 
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‘•best**  matching,  a  completely  different  type  of  procedure  (e.g.,  algorithms 
such  as  those  incorporating  matched  filtering-see  Woody  [1103])  is 
used  to  optimize  signal  detection,  minimize  errors,  and  reduce  search  time 
(see  [672,704,11231). 

Probability  as  a  Descriptor  of Motor  Effectuation:  The  Conditional  Probability 
of  Sorting.  An  Algebra  of  Events 

Just  as  entropy  is  relatablc  to  the  uncertainty  of  configurations  of  gas  mole¬ 
cules  in  a  dimensional  space,  and  provides  some  measure  thereof,  so  does 
probability  provide  a  measure  or  index  of  the  likelihood  of  events-  As  we 
have  seen  from  the  work  of  Boltzmann  and  of  Shannon,  the  events  may  be 
physical-chemical  or  they  may  be  informational-probabilistic. 

Just  as  chemical  events  may  be  described  as  occupying  a  space  [328  ] ,  so 
may  other  probabilistic  events  be  described  in  terms  of  the  space  they  occupy. 
The  space  of  probabilistic  events  is  described  by  set  theory  and  Venn  dia¬ 
grams  thereof.  The  sample  space  (Fig.  7.31)  represents  the  number  of  possible 
different  arrangements  of  sample  points  or  outcomes,  and  each  event  or  spe¬ 
cific  outcome  in  the  sample  space  can  be  assigned  a  probability  of  occurrence. 

Set  theory  is  described  by  a  set  of  axioms  that  fully  define  the  algebra  of 
events  [cf.  240]  .With  respect  to  Fig.  7.31,  they  are: 

1.  A  +  B  3B  +A  (commutative  law);also  for  multiplication,  AB  *  BA 

2.  A  +  (3  +  C)  =(A+B)  +  C  (associative  law);  also  for  multiplication,  A  (By)  3 
(AB)Y 

3.  A  (B  +  C)  3  AB  ♦  AC  (distributive  law) 

4j  (A')'  3  A  (' 3  “not”  or  the  complement  of  whatever  it  follows) 

5.  (AB)  3 A'  +B* 

6.  AAf  3  $  ($  3  complement  of  If) 

7.  AU  3  A  (U  3  union  of  two  events— the  collection  of  ail  points  in  either  or 
both  event  spaces) 

T7iii  set  of  axioms  is  also  the  set  of  constraints  by  which  linear  systems  are 
bound  and  defined. 

Simple  Probability .  Could  probability  be  used  to  describe  motor  effectu¬ 
ation,  i.e.,  the  motor  events  (or  decisional  space)  possible  as  outcomes  of  a 
particular  network?  If  so,  could  some  general  formulation  be  derived,  com¬ 
parable  to  the  group  invariance  theorem  to  permit  a  general  algebraic  treat¬ 
ment  of  the  geometry  of  sorting  or  motor  effectuation?  The  answer  to  the 
first  question  is  yes;  the  answer  to  the  second,  perhaps.  The  sample  space,  5, 
of  possible  motor  outcomes  is  made  up  of  a  number  of  points,  Ex ,  E\ , .  - 
En .  Each  point,  £*,  has  an  expected  probability  of  occurrence  B  (£*£).• 
The  probability  of  occurrence  of  event  A,  B(A),  is  the  sum  of  the  proba¬ 
bilities  of  all  points  within  it.  The  sum  of  the  probabilities  of  occurrence  of 
all  points  equals  1,  which  is  equal  to  the  probability  of  the  entire  sample 
space.  Thu s,P(4)  must  be  between  0  and  1. 

•Event  A  may  be  mapped  from  sets  oiP(E^). 
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Sample  Space 


Conditional  Probability .  Conditional  probability  deals*  with  the  probability, 
of  an  event  A  occurring  given  that  some  other  event  B  has  just  occurred.  If 
the  events  are  completely  independent,  the  probability  of  event  A  occurring 
wOl  be  equal  to  the  general  probability  of  occurrence  of  event  A,P(A).  If 
there  is  some  dependency,  the  probability  of  event  A  occurring,  once  B  has 
occurred,  may  be  different  from  the  general  probability  of  occurrence  of 
event  A.  Bayes  has  systematized  this  relationship.  If  one  thinks  of  B  as  the 
causal  event  and  as  the  affected  event,  the  probability  that  A  occurs  given 
that  B  has  occurred,  P(A/B)f  is  equal  to  the  genera]  probability  of  occurrence 
of  A  fP(A)f  times  the  probability  of  the  effect#  given  that  the  phenomenon 
A  has  occurred,  P(B/A)y  divided  by  the  probability  of  event  B,P(B).  Thus: 


P{A/B)  = 


it*)  PWA) 
P(B) 


<7-56) 


Interestingly,  this  theorem  may  be  generalized  to  encompass  the  relation¬ 
ship  of  a  set  of  events  A  x ,  A2 ,  . .  An .  This  is  because  P{B)  will  equal 
P[(4i+A2+...An)B)0T  ZP(Af&y. 


Thus, 


M 

M 


(737) 


It  can  be  shown  that: 

N  If 

(738) 
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ATTACHMENT  A 


University  of  California.  Los  Angeles 
Campus  Veterinarian,  1  C.HS. 
Telephone:  (213)  825-G240 


_ Office  Use  Only _ 

Application  H Project  in  tt 
Effective aCj.  —  Expiration  -a 


sZtS'- 

- Uftt- 


APPLICATION  FOR  USE  OF  LABORATORY  ANIMAL  SUBJECTS 

A  separate  application  must  be  completed  and  typewritten  for  each  proposed  project  or  activity  utilizing 
animals.*  Applications  should  be  directed  to  the  Campus  Veterinarian  for  review,  but  can  be  sent  after  funding 
agency  deadlines.  Hr. ‘.ever,  an  approved  application  is  required  for  the  University  to  accept  extramural  funds 
and  before  any  animals  can  be  ordered. 


Applicant. 


Charles  D.  Woody,  MD 


Phone:  Offir»  82  5~0 187 _ Home _ 

„  •  NPI/MR 

Department/  Division _ _ _ _ . _ 

Title  of  Research  or  Training  Project/ Activity _ CfeUTOphyS  j  Qlpgi  Cfll.-f 

the  Investigation  of  Adaptive  Network  Architectures 


Estimated  Starting  Date. 


.Estimated  Completion  Date. 


-/) 


The  undersigned  attests  to  the  attached  information,  and  agrees  to  accept  responsibility  that  all  animal  use  in  the 
above-titled  project  or  activity  will  be  in  accordance  with  University,  Federal,  and  other  relevant  policies  and 
regulations.  Any  changes  will  be  communicated  to  the  Chancellor's  Committce/Campus  Veterinarian. 


Signature. 


Charles  D,  Woody,  MD 


}  /  (Date) 

resAor  of  Anatomy  and  Psychiatry 


•"Animal’*  means  any  live  or  dead  vertebrate. 


For  Committee  Use  Only 


Qapi 


/  Effective  Dale  c  0 

Application  Approved:  Expiration  Date 


Comments: 


jzn 


Application  Disapproved 


SignaWu^ 


sxLslJf  A  ^Cfl'dL 


(Title)  // 
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University  of  California,  Los  Angeles 
Campus  Veterinarian,  IV-21 1  C.H.S. 
Telephone:  (213)  825*6240 


Office  Use  Only  . 

Application  y  ~  Protect  ID  #  —  f  ^  ^ 

Effective  CL  —  ^ ~  Expiration  —  ^  f  ~ C* 


APPLICATION  FOR  USE  OF  LABORATORY  ANIMAL  SUBJECTS 

_ Department _ NP  I /Mft _ 


1.  Applicant  __  Charles  D.  Woodv.  MD 

Phone:  Office  ft?^-01  R7 _ Home 


2.  Contact  for  animal  problems  &  emergencies _ 

Phone:  Off  ice  82 5*01  87 _ Home. 


Charles  D.  Wnnriy,  MD 


3.  T 


4. 

5. 

6. 

7. 

8. 

9. 

10. 

11. 

12. 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20. 
21. 

22. 

23. 


jtle  of  research  or  training  oroiect/activjtv  —  NeUrQPhYS  IQ] QftTCa 1  RfiSParrft  Support the 

Investigation  of  Adaptive  Network  Architecures  J 

O'/ 

i*  w 

Starting  Date.  6/1/80  to.  5/31/8* 

□  New  09 Continuation  EH  Renewal  D Supplemental 
Q Extramural  funding.  Acad.  Senate,  or  Cai.  Inst,  for  Cancer  Res.:  Attach  copy  of  proposal  application. 

□  Intramural  or  other  funding:  On  cont.  page  outline  project's  objectives,  animal  purchasing  &  care  budget. 

Animal  Use  Sites  —  buitding(s)/room(s) _ 58"»147,  58-*  1  59,  57*384, _ 

For  animals  held  in  laboratory  more  than  12  hours,  does  housing  conform  to  DHEW  Guide:  C3  Yej  □  No 
Specit»/Str»in/Br««d  Ca  t _ _  _  Sex _ Age/Weight  Rangf _ '  ~ 


20-40 

Total  number  (or  entire  oroiect/activitv  pgr  annum  Expected  Daily-Population  1  2 _ 

□  Special  procurement  or  processing  needs:  Specify  on  continuation  page. 

□  Procurement  of  dead  animal  material:  Answer  questions  1-12  only  and  sign  application. 

0  Short  term  use  (up  to  2  weeks)  Q  Long  term  use  (more  than  2  weeks)  Q  Both  0  Breeding  program 
0  Standard  housing,  diet,  sanitation  &  pest  control  0  Special  needs:  Specify  on  continuation  page. 
n  Project  involves  no  pain  or  distress  to  animal  subjects.  Refer  to  "Guiding  Principles"  ff5. 

(3  Project  involves  probable  pain  or  distress  to  animal  subjects.  Details  of  procedures  on  animals 

presented  in:  Q  proposal  application  0  continuation  page  £]  attached  journal  reprint 

0  Pain  or  distress  r^icvedby  anesthetic,  analgesics,  tranquilizers.  Use  cont.  page  for  addl  drugs. 

Cite:  Druofs)  NA  Pentobarbital _ DoMM  sOmgm/kg  IP 

O  Pam  or  distress  cannot  be  relieved.  Explain  basis  for  exception  on  continuation  page. 

0  Surgery:  Q  Nonsurvival  ^Survival  [J]  Aseptic  Surgery  Q Multiple  surgeries  on  same  animal 
Procedure  for  sick  /dead  animals:  O  Veterinary  attention  Q  Discard  0  Notify  applicant 

_ Route  -_IP _ 


Q  Euthanasia:  Cite:  druofs)  Nfifllblital 
Cite  other  method(s) 


0  Special  veterinary  &  technical  services  required:  Specify  on  continuation  page. 

O  Potential  biological  or  radiation  hazard  to:  Q  Humans  O  Animals  Describe  on  continuation  paga. 

US£  CONTINUATION  PAGE  IS)  FOR  AOOI TJONAL  INFORMATION 
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